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Abstract. The differential X-calculus is a paradigmatic functional programming language en- 
dowed with a syntactical differentiation operator that allows to apply a program to an argument 
in a linear way. One of the main features of this language is that it is resource conscious and 
gives the programmer suitable primitives to handle explicitly the resources used by a program 
during its execution. The differential operator also allows to write the full Taylor expansion 
of a program. Through this expansion every program can be decomposed into an infinite sum 
(representing non-deterministic choice) of 'simpler' programs that are strictly linear. 

The aim of this paper is to develop an abstract 'model theory' for the untyped differential 
A-calculus. In particular, we investigate what should be a general categorical definition of de- 
notational model for this calculus. Starting from the work of Blute, Cockett and Seely on 
differential categories we provide the notion of Cartesian closed differential category and we 
prove that linear reflexive objects living in such categories constitute sound models of the un- 
typed differential A-calculus. We also give sufficient conditions for Cartesian closed differential 
categories to model the Taylor expansion. This entails that every model living in such categories 
equates all programs having the same full Taylor expansion. 

We then provide a concrete example of a Cartesian closed differential category modeling the 
Taylor expansion, namely the category MRel of sets and relations from finite multisets to sets. 
We prove that the relational model & of A-calculus we have recently built in MRel is linear, 
and therefore it is also a model of the untyped differential A-calculus. 

Finally, we study the relationship between the differential A-calculus and the resource calculus, 
a functional programming language combining the ideas behind the differential A-calculus with 
those behind the A-calculus with multiplicities. We define two translation maps between these 
two calculi and we study the properties of these translations. In particular, from this analysis 
it follows that the two calculi share the same notion of model. Therefore the resource calculus 
can be interpreted by translation into every linear reflexive object living in a Cartesian closed 
differential category. 
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Introduction 

Among the variety of computational formalisms that have been studied in the literature, 
the A-calculus [ [3j plays an important role as a bridge between logic and computer science. 
The A-calculus was originally introduced by Church [[151 [16] as a foundation for mathematics, 
where functions - instead of sets - were primitive. This system turned out to be consistent 
and successful as a tool for formalizing all computable functions. However, the A-calculus is 
not resource sensitive since a A-term can erase its arguments or duplicate them an arbitrary 
large number of times. This becomes problematic when one wants to deal with programs that 
are executed in environments with bounded resources (like PDA's) or in presence of depletable 
arguments (like quantum data that cannot be duplicated for physical reasons). In these contexts 
we want to be able to express the fact that a program actually consumes its argument. Such 
an idea of 'resource consumption' is central in Girard's quantitative semantics [ |25]. This 
semantics establishes an analogy between linearity in the sense of computer science (programs 
using arguments exactly once) and algebraic linearity (commutation of sums and products with 
scalars), giving a new mathematically very appealing interpretation of resource consumption. 
Drawing on these insights, Ehrhard and Regnier [[21] designed a resource sensitive paradigmatic 
programming language called the differential X- calculus. 

The differential lambda calculus is a conservative (see [ (2,11 Prop. 19]) extension of the 
untyped A-calculus with differential and linear constructions. In this language, there are two 
different operators that can be used to apply a program to its argument: the usual application 
and a linear application. This last one defines a syntactic derivative operator Ds ■ t which is an 
excellent candidate to increase control over programs executed in environments with bounded 
resources. Indeed, the evaluation of Ds ■ t (the derivative of the program s on the argument 
t) has a precise operational meaning: it captures the fact that the argument t is available for 
s "exactly once" . The corresponding meta-operation of substitution, that replaces exactly one 
(linear) occurrence of x in s by t, is called "differential substitution" and is denoted by || ■ t. 
It is worth noting that when s contains several occurrences of x, one has to choose which 
occurrence should be replaced and there are several possible choices. When s does not contain 
any occurrence of x then the differential substitution cannot be performed and the result is 
(corresponding to an empty program). Thus, the differential substitution forces the presence 
of non-determinism in the system, which is represented by a formal sum having as neutral 
element. Therefore, the differential A-calculus constitutes a useful framework for studying the 
notions of linearity and non-determinism, and the relation between them. 

Taylor expansion. As expected, iterated differentiation yields a natural notion of linear 
approximation of the ordinary application of a program to its argument. Indeed, the syntactic 
derivative operator allows to write all the derivatives of a A-term M, thus it also allows (in 
presence of countable sums) to define its full Taylor expansion M* . In general, M* will be 
an infinite formal linear combination of simple terms (with coefficients in a field), and should 
satisfy, when M is a usual application NQ: 




where ^ is a numerical coefficient and D*^ • (Q, . . . ,Q) stands for iterated linear application 
of to n copies of Q. The precise operational meaning of the Taylor expansion has been 
extensively studied in [ |2H [22l . The crucial fact of such an expansion is that it gives a 
quantitative account to the /3-reduction of A-calculus (in the sense of Bohm tree computation). 
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Formal connections between Taylor expansions and Bohm trees of usual A-terms have been 
presented in [[22], using a decorated version of Krivine's machine. 

The resource calculus, which is a revisitation of Boudol's A-calculus with multiplicities [ 
[71 [8] , shows an alternative approach to the problem of modeling resource consumption within 
a functional programming language. In this calculus there is only one operator of application, 
while the arguments can be either linear or reusable and come in finite multisets called 'bags'. 
Linear arguments must to be used exactly once, while reusable ones can be used ad libitum. Also 
in this setting the evaluation of a function applied to a bag of arguments may give rise to dif- 
ferent possible choices, corresponding to the different possibilities of distributing the arguments 
between the occurrences of the formal parameter. 

The main differences between Boudol's calculus and the resource calculus are that the former 
is affine, is equipped with explicit substitution and has a lazy operational semantics, while the 
latter is linear and is a true extension of the classical A-calculus. The current formalization of 
resource calculus has been proposed by Tranquilli in [ |35] with the aim of defining a Curry- 
Howard correspondence with differential nets [l23|. 

The resource calculus has been recently studied from a syntactical point of view by Pagani and 
Tranquilli [[31] for confluence results and by Pagani and Ronchi della Rocca [i30j for results about 
may and must solvability. Algebraic notions of models for the strictly linear fragment of resource 
calculus have been proposed by Carraro, Ehrhard and Salibra in [T^. In the present paper we 
mainly focus on the study of the differential A-calculus, but we will also draw conclusions for 
the resource calculus. 

Denotational semantics. Although the differential A-calculus is born from semantical con- 
siderations (i.e., the deep analysis of coherent spaces performed by Ehrhard and Regnier) the 
investigations on its denotational semantics are at the very beginning. It is known that finite- 
ness spaces [ T!9] and the relational semantics of linear logic [ [25] are examples of models of the 
simply typed differential A-calculus, thus having a very limited expressive power. Concerning 
the untyped differential A-calculus, it is just known in the folklore that the relational model & 
introduced in [ lOj in the category MRel constitutes a concrete example of modeH. This picture 
is reminiscent of the beginning of denotational semantics of A-calculus, when Scott's was the 
unique concrete example of model of A-calculus and no general definition of model was known. 
Only when an abstract model theory for this calculus has been developed the researchers have 
been able to provide rich semantics (like the continuous [IM], stable [[4] and strongly stable 
semantics ['O]) and general methods for building huge classes of models in these semantics. 

Categorical notion of model. The aim of the present paper is to provide a general cat- 
egorical notion of model of the untyped differential A-calculus. Our starting point will be the 
work of Blute, Cockett and Seely on (Cartesian) differential categories [[SI [6]. In these cate- 
gories a derivative operator D{—) on morphisms is equationally axiomatized; the derivative of 
a morphism f : A ^ B will be a morphism D{f) : A >^ A ^ B, linear in its first component. 
The authors have then proved that these categories are sound and complete to model suitable 
term calculi. However, it turns out that the properties of differential categories are too weak for 
modeling the full differential A-calculus. For this reason, we will introduce the more powerful 
notion of Cartesian closed differential category. In such categories it is possible to define an 
operator 



^ This follows from [ (2^ where it is shown that the differential A-calculus can be translated into differential 
proofnets, plus [[37] where it is proved that is a model of such proofnets. 
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that can be seen as a categorical counterpart of the differential substitution. Intuitively, the 
morphism f -k g is obtained by force-feeding the second argument A of f with one copy of the 
result of g. The type is not modified because f *g may still depend on A. 

The operator -k allows us to interpret the differential A-calculus in every linear reflexive object 
^ living in a Cartesian closed differential category C. We will prove that this categorical 
notion of model is sound; this means that the induced equational theory Th(^) is actually a 
differential X-theory. The problem of equational completeness for this notion of model is left for 
future works, and will be discussed in Section [71 

We will also investigate what conditions the category C must satisfy in order to model the 
Taylor expansion. This entails that all differential programs having the same Taylor expansion 
are equated in every model living in C. 

Relational semantics. In [jlO] we have built, in collaboration with Bucciarelli and Ehrhard, 
an extensional model & of A-calculus living in the category MRel of sets and "relations from 
finite multisets to sets". By virtue of its relational nature, ^ can be used to model several 
systems, beyond the untyped A-calculus. For instance, in [ [11] the authors have proved that 
it constitutes an adequate model of a A-calculus extended with non-deterministic choice and 
parallel composition, while in [|37] Vaux has shown that it is a model of differential proof-nets. 

In the present paper we study ^ as a model of the untyped differential A-calculus. Indeed (as 
expected) the category IVIRel turns out to be an instance of the definition of Cartesian closed 
differential category, and the relational model is easily checked to be linear. We will then 
study the equational theory induced by ^ and prove that it equates all terms having the same 
Taylor expansion. This property follows from the fact that MRel models the Taylor expansion. 

Translations. Finally, we study the inter-relationships existing between the differential A- 
calculus and the resource calculus. Actually there is a common belief in the scientific community 
stating that the two calculi are morally the same, and the choice of studying one language or the 
other one is more a matter of taste than a substantial difference. We will give a formal meaning 
to this belief by defining a translation map (•)'" from the differential A-calculus to the resource 
calculus, and another map (•)'^ in the other direction. We will prove that these translations 
are 'faithful' in the sense that equivalent programs of differential A-calculus are mapped into 
equivalent resource programs, and vice versa. This shows that the two calculi share the same 
notion of denotational model; in particular the resource calculus can be interpreted by translation 
in every linear refiexive object living in a Cartesian closed differential category. 

Outline. 

Section [T] contains the preliminary notions and notations needed in the rest of the paper. In 
Section [2] we present the syntax and the axioms of the differential A-calculus, and we define 
the associated equational theories. In Section [3] we introduce the notion of Cartesian closed 
differential category. Section [His devoted to show that linear reflexive objects in such categories 
are sound models of the differential A-calculus. In Section [5] we build a relational model S' and 
provide a partial characterization of its equational theory. In Section [6l we define the resource 
calculus and we study its relationship with the differential A-calculus. Finally, in Section [71 we 
present our conclusions and we propose some further lines of research. 

1. Preliminaries 

To keep this article self-contained we summarize some definitions and results that will be used 
in the sequel. Our main reference for category theory is [IT]. 
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1.1. Sets and Multisets 

We denote by J\f the set of natural numbers. Given n G we write for the set of all 
permutations (bijective maps) of the set {1, . . . , n}. 

Let A be a set. We denote by 'P{A) the powerset of A. A multiset m over A can be defined 
as an unordered list m = [01,02,...] with repetitions such that ai ^ S for all indices i. A 
multiset m is called finite if it is a finite list; we denote by [] the empty multiset. Given 
two multisets mi = [01,02, . . .] and m2 = [^1,62, • • •] the multi-union of mi, 7712 is defined by 
TOi I±)m2 = [oi, 61, 02,62, •••]• 

Finally, we write Mf{A) for the set of all finite multisets over A. 

1.2. Cartesian (Closed) Categories 

Let C be a Cartesian category and A,B,C be arbitrary objects of C. We write C{A,B) for 
the homset of morphisms from A to B; when there is no chance of confusion we write f : A ^ B 
instead of / G C{A,B). We usually denote by ^4 x 5 the categorical product of A and B, by 
TTi : Ax B ^ A, Tr2 ■ Ax B ^ B the associated projections and, given a pair of arrows f : C ^ A 
and g : C ^ B,hy {f,g) : C ^ Ax B the unique arrow such that 7rio(/, g) = f and iT2°{f, g) = g- 
We write / x 5 for the product map of f and g which is defined hy f x g = (/ovri, (/o7r2). 

If the category C is Cartesian closed we write A^B for the exponential object and ev^^ : [A^ 
B]x A ^ B for the evaluation morphism. Moreover, for any object C and arrow f : C x A ^ B, 
A(/) : C [A^ B] stands for the (unique) morphism such that evAB°i^{f) xld^) = /. Finally, 
1 denotes the terminal object and \a the only morphism in C{A, 1). 

We recall that in every Cartesian closed category the following equalities hold: 

(pair) {f,g)oh={foh,goh) A(/) 05 = A(/o (5 x Id)) (Curry) 

(beta-cat) ev o {A{f), g) = f o (Id, g) A(ev) = Id (Id-Curry) 

Moreover, we can define the uncurry operator A~(— ) = evo(— x Id). From (beta-cat), (Curry) 
and (Id-Curry) it follows that A(A~(/)) = / and A^{A{g)) = g. 

2. The Differential Lambda Calculus 

In this section we recall the definition of the differential X-calculus [[2T], together with some 
standard properties of the language. We also define the associated equational theories, namely, 
the differential X-theories. The syntax we use in the present paper is freely inspired by [136]. 

2.1. Differential Lambda Terms 

The set A'^ of differential X-terms and the set A* of simple terms are defined by mutual 
induction as follows: 

A'^ : S,T,U,V ::= 0\s\s + T A': s,t,u,v::= x \ Xx.s \ sT \ D s ■ t 

The differential A-term Ds ■ t represents the linear application of s to t. Intuitively, this means 
that s is provided with exactly one copy of t. Notice that sums may appear also in simple terms 
as right components of ordinary applications. Although the rule s + t = s will not be valid in our 
axiomatization, the sum should still be thought as a version of non-deterministic choice where 
all actual choice operations are postponed. 

Convention 2.1 We consider differential X-terms up to a-conversion, and up to associativity 
and commutativity of the sum. The term is the neutral element of the sum, thus we also add 
the equation 5 + = 5. 
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As a matter of notation we write Xxi...Xn-s for Axi.(- • • (Ax„.,s) • • • ) and sTi • • • for 
{■■■{sTi)---)Tk. Moreover, we set s ■ (ti) = Ds -ti and D"+is • (t, ti, . . . , t„) = D"(Ds • 
t) ■ {ti, . . . , t„). When writing D"s • (ti, . . . , t„) we suppose n > 0, unless differently stated. 

Definition 2.2 The permutative equality on differential X-terms imposes that D"' s-{ti, . . . , t„) = 
□"s • (to-(i), • • • , to-(n)) for all permutations a G (3„. 

Hereafter, we will consider differential A-terms also up to the permutative equality. This is 
needed, for instance, for proving the Schwarz lemma (see Subsection 12. 2p and hence to speak of 
a differential operator. Concerning specific A-terms we set: 

I = Xx.x A = Xx.xx n = AA Y = Xf.{Xx.f{xx)){Xx.f{xx)) 
s = Xnxy.nx{xy) n = Xsx.s^{x), for every natural number n E A/" 

where = stands for syntactical equality up to the above mentioned equivalences on differential A- 
terms. Note that I is the identity, Y is Curry's fixpoint combinator, n the n-th Church numeral 
and s implements the successor function. denotes the usual paradigmatic unsolvable A-term. 

Definition 2.3 Let S he a differential X-term. The set FV(5) of free variables of S is defined 
inductively as follows: 

• FY{x) = {x}, 

• FV(Ax.s) = FV(s) - {x}, 

• FV(sT) = FV(s) UFV(r), 

• FV(Ds-t) =FV(s)UFV(t), 

• FV(s + S)= FV(s) U FY{S), 

• FV(0) = 0. 

Given differential X-terms Si, . . . , Sk we set FV(5i, . . . , Sk) = FV(S'i) U • • • U FV(5fc). 

We now introduce some notations on differential A-terms that will be particularly useful to define 
the substitution operators in the next subsection. 

Notation 2.4 We will often use the following abbreviations (notice that these are just syntactic 
sugar, not real terms): 

• Si) = Xx.Si, 

• (E ti s^)T = Eti s.T, 

• D(Eti«.)-(E-=it.) = E„D..-t,. 

Intuitively, these equalities make sense since the lambda abstraction is linear, the usual appli- 
cation is linear in its left component, and the linear application is a bilinear operator. Notice 
however that S{TJl^^ti) S^^^^ti. 
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2.2. Substitutions 

We introduce two kinds of meta-operations of substitution on differential A-terms: the usual 
capture-free substitution and the differential substitution. Both definitions strongly use the 
abbreviations introduced in Notation 12.41 



y{T/x} 



Definition 2.5 Let S, T be differential X-terms and x be a variable. The capture-free substitu- 
tion ofT for X in S, denoted by S{T/x}, is defined by induction on S as follows: 

T ifx = y, 
y otherwise, 

• {Xy.s){T/x} = \y.s{T/x}, where we suppose by a-conversion that x y and y ^ FV(T), 
. isU){T/x} = {s{T/x}){U{T/x}), 

. {D^s-{ui,...,Un)){T/x} = D"(s{T/x}) • {ui{T/x},...,Un{T/x}), 

• 0{T/x} = 0, 

• {s + S){T/x} = s{T/x} + S{T/x}. 

Thus, S{T/x} is the result of substituting T for all free occurrences of x in S, subject to 
the usual proviso about renaming bound variables in S to avoid capture of free variables in 
T. On the other hand, the differential substitution ^ • T defined below denotes the result of 
substituting T (still avoiding capture of variables) for exactly one - non-deterministically chosen 
- occurrence of x in S. If such an occurrence is not present in S then the result will be 0. 



Definition 2.6 Let S, T be differential X-terms and x be a variable. The differential substitution 

as 

dx 



of T for X in S, denoted by ■ T, is defined by induction on S as follows: 



dy ^ i T ifx = y, 
1^ otherwise, 

Wxm-T={f^-T)U + {Ds-{%-T))U, 

-^{Xy.s) ■ T = Xy.^ ■ T, where we suppose by a-conversion that x ^ y and y ^ FV(T), 
^(D-5-(ni,...,^z„))-r = D"(f .r).(ni,...,tx„) + Er=i • (m, . . . , ^ • T, . . . , nj, 

l{s + U).T=%.T + ^-T. 

The definition states that the differential substitution distributes over linear constructions. 
We now spend some words on the case of the usual application sU because it is the most complex 
one. The result of • T is the sum of two terms since the differential substitution can non- 

deterministically be applied either to s or to U. In the first case, we can safely apply it to s 
since the usual application is linear in its left argument, so we obtain • T)U. In the other 
case we cannot apply it directly to U because the standard application is not linear in its right 
argument. We thus follow two steps: (i) we replace sU by (Ds •[/)[/ ; (ii) we apply the differential 
substitution to the linear copy of U. 

Intuitively, this works because U is morally available infinitely many times in sU, so when the 
differential substitution goes on U we 'extract' a linear copy of U, that receives the substitution, 
and we keep the other infinitely many unchanged. This will be much more evident in the 
definition of the analogous operation for the resource calculus (cf. Definition 16. 3p . 
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Example 2.7 Recall that the simple terms A and I have been defined at page^ 

1. ^'1 = 0, since x does not occur free in A, 

2. i-i=i, 

4- • I) • A = (DI • A)x + (D A • I)x + (D(Dx • I) • A)x, 

5. {{Dx-x)x){I/x} = (DI-I)I. 

The differential substitution ^ • T can be thought as the differential of S with respect to 

the variable x, linearly applied to T. This may be inferred from the rule for linear application, 

which relates to the rule for composition of the differential. Moreover, it is easy to check that if 

as 

dx 

by the validity of the Schwartz lemma. 



X ^ FV(S') (i.e., S is constant with respect to x) then = 0. This intuition is also reinforced 



Lemma 2.8 (Schwartz lemma) Let S,T,U be differential X-terms. Let x and y be variables 
such that X does not occur free in U. Then we have: 

d_(dS ,r^\ ,JJ _ d_(dS ,Tj\ ,dS ,(&T ,TJ 

dy\dx ^ ) ^ - dx\dy ^ ) ^ ^ dx \dy ^ 

In particular, when y ^ FV(T), then the second addend is and the two differential substitutions 
just commute. 

Proof. The proof is by structural induction on S. Here we just check the case 5 = vV. 

Wy(^-T)-U = ^y{{^,-T)V+{Dv{^-T))V)-U 

= i^yi^x-T)-U)V + {D{^^-T)-i^.U))V 



+ i^ify-U)-m- T))V + (D^ . (^(^ • T) . U))V 

+ (D(D^.(|^.r).(f .c/)))y 

By applying the induction hypothesis (and the permutative equality) we get: 

j-y{^-T)-U = {U%-U)-T)y + {^{%-U)-{^-T))V + {D{^^-T)-{%.U))V 

+ (D^; . (^(f • [/) . T))V + (D(Dr; • (f • U)) ■ (|| • T))V 
+ i%-m-U))V+{Dv.{%.{^.U)))V 
= M%-U)V+{Dv.{%.U))V)-T 

+ i'm-i%-u))v + {Dv{^^.{^j-u)))v 

8 I dvV Tj\ rp I dvV j dT tt\ 

~ dx\ dy ■ ^ ) ■ ^ dx ' \dy ' ^ )■ 

■ 

For the sake of readability, it will be sometimes useful to adopt the following notation for 
multiple differential substitutions. 

Notation 2.9 We set 

d"S (i- + \ — _d_f 9^ + \ + 

dxi,...,xn • IH' • • • ' '-"J — dxn\"' dxi ' ''^ ' " ) ' ''n 

where Xi ^ FV(ti, . . . , tn) for all 1 < i < n. 
Remark 2.10 From Lemma \2. ^ we have: 



dxZix^ ■ •••'*«) = fe,(i^,".!x,(„) ■ • • ' for all a € 6„. 
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2.3. Differential Lambda Theories 

In this subsection we introduce the axioms associated with the differential A-calculus and we 
define the equational theories of this calculus, namely, the differential X-theories. 

The axioms of the differential X-calculus are the following (for all s,t e and T G A'^): 

(P) {Xx.s)T = s{T/x} 

{Pd) D{Xx.s)-t = Xx.^-t. 

Once oriented from left to right, the (/3)-conversion expresses the way of calculating a function 
Xx.s classically applied to an argument T, while the (^£))-conversion the way of evaluating a 
function Xx.s linearly applied to a simple argument t. 

Notice that in the result of a linear application the Xx does not disappear. This is needed 
since the simple term s may still contain free occurrences of x. The only way to get rid of the 
outer lambda abstraction in the term Xx.s is to apply it classically to a term T, and then use 
the (^)-rule; when x ^ FV(s) a standard choice for T is 0. 

The differential A-calculus is an intensional language — there are syntactically different pro- 
grams having the same extensional behaviour. We will be sometimes interested in the extensional 
version of this calculus which is obtained by adding the following axiom (for every s G A*): 

(rj) Xx.sx = s, where x ^ FV(s) 

A X'^ -relation T is any set of equations between differential A-terms (which can be thought as a 
relation on A'' x A*^). 

A A'^-relation T is called: 

• an equivalence if it is closed under the following rules (for all S,T,U G A*^): 

T = S S = T T = U 
reflexivity — — symmetry — transitivity 



S=s ' S=T ' ' S=U 

• compatible if it is closed under the following rules (for all S,T,U,Si G A*^ and s,t,u,Si G 
A^): 

s = S , , , s = S T = U s = S u = U J 

lambda — „^ _ otj — ^PP r^,. „. _ o tt ^app 



Xx.s = Xx.S " sT = SU Ds-u=DS-U 



Sj for all 1 < i < ra 

~ ~ sum 



En \-^n Q 

1=1 ~ Z^i=l '-'i 



As a matter of notation, we will write T \- S = T oi S =7- T for 5 = T G T. 

Definition 2.11 A differential A-theory is any compatible X'^-relation T which is an equivalence 
relation and includes {fi) and {Pd)- T is called extensional if it also contains {rj). 

The differential A-theories are naturally ordered by set-theoretical inclusion. We denote by 
XP'^ (resp. XPr]'^) the minimum differential A-theory (resp. the minimum extensional differential 
A-theory) . 

We present here some easy examples of equalities between differential A-terms in Xjd'^ (and 
XPr]"^) in order to help the reader to get familiar with the operations in the calculus. 

Example 2.12 Recall that A = Xx.xx. Then we have: 
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1. h (DA ■y)z = yz+{Dz- y)z, 

2. h (D^A • (x,y))0 = (Dx • y)0 + (Dy • x)0, 

3. Xl3'^ h D^A • {x,y,z) = Xr.{D'^x ■ {y,z) + D^y • {x,z) + D^z • (x,y) + D^r • (x,y,z))r, 
^. A/Sr/*^ h DA • z = Ax.zx + Ax.(Dx • z)x = z + Ax.(Dx • z)x. 

Note that in this calculus (as in the usual A-calculus extended with non-deterministic choice 
[118]) a single simple term can generate an infinite sum of terms, like in the example below. 

Example 2.13 Recall (from page^ that Y is Curry's fixpoint combinator, n is the n-th Church 
numeral and s denotes the successor. 

1. XP'^ h Y(x + y) = x(Y(x + y)) + y{Y{x + y)) for all variables x, y, 

2. A/?"^ h Y((Az.O) + s) = + s(Y((Az.O) + s)) = + i + s(s(Y((Az.O) + s))) = • • • 

2.4. A Theory of Taylor Expansion 

One of the most interesting consequences of adding a syntactical differential operator to the 
A-calculus is that, in presence of infinite sums, this allows to define the Taylor expansion of a 
program. Such an expansion is classically defined in the literature only for ordinary A-terms [ 
[2T \ \22 \ \2^. In this subsection we generalize this notion to general differential A-terms. To avoid 
the annoying problem of handling coefficients we consider an idempotent sum. 

Definition 2.14 Given a differential X-term S we define its (full) Taylor expansion S* by 
induction on S as follows: 

• X* = X, 

• (Ax.s)* = Ax.s*, 

. {D>'s-{ti,...,tk)r = D''s* ■{tl,...,tl), 

• (sT)* = Sfe(=7v^(D'^ s* • (T*, . . . ,T*))0, where M denotes the set of natural numbers, 

• (s + T)* = s* + T*. 

Thus, the "target language" of the Taylor expansion is much simpler than the full differential 
A-calculus. For instance, the general application of the A-calculus is not needed anymore, we 
will only need iterated linear applications and ordinary applications to 0. We will however need 
countable sums, that are not present in general in the differential A-calculus. Hereafter, the 
target calculus of the Taylor expansion will be denoted by A^. 

We will write S to denote sequences of differential A-terms Si, . . . , Sk (with A; > 0). 

Remark 2.15 Every term S S can be written as a (possibly infinite) sum of terms of shape: 

Ay.(D"M---(D"'=5-(4))0)----(ri))0 

where ti is a sequence of simple terms of length Ui ^ M (for i < i < k) and the simple term s 
is either a variable or a lambda abstraction. 
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We now try to clarify what does it mean that two differential A-terms S and T "have the 
same Taylor expansion". Indeed we may have that S* = Sjg/Sj and T* = J^j^jtj where I, J are 
countable sets. In this case one could be tempted to define S* = T* by asking for the existence 
of a bijective correspondence between I and J such that each Sj is A/3°'-equivalent to some tj. 
However, in the general case, this definition does not capture the equivalence between infinite 
sums that we have in mind. For instance, S* = T* might hold because there are partitions 
{Ik}kGK and {Jk}k£K of / and J, respectively, such that for every k G K the sets Ik,Jk are 
finite and Y^i^i^Si =xj^d Tii^j^^Sj. The naif definition works well when all addenda of the two 
sums we are equating are 'in normal form'. Since the AJ^ calculus (morally) enjoys strongly 
normalization, we can define the normal form of every S G AJ^ as follows. 

Definition 2.16 Given S € A^, we define the normal form of S as follows. 
•IfS = Y.^eI Si we set NF(5) = ^ie/ NF(si). 

• IfS = Ay.(D"i (• • • (D"fe X ■ (4))0) • • • • {ti))0 then: 

NF(5) = Ay.(D"i (• • • (D"^ x ■ (NF(4)))0) • • • • (NF(fi)))0. 

• If S = Ay.(D"i (• • • (D'^fc {Xx.s) ■ {tk))0) ■■■ ■ (fi))0 with > then: 

NF(5) = NF(Ay.(D"^ (• • • (D"^- ((Ax.^ • (4))0) • (4_i))0) • • • • ih))0}. 

• IfS = Ay.(D"i (• • • (D'^fe ((Ax.s)OO) • {tk))0) ■■■■ (fi))0 then: 

NF(5) = NF(Ay.(D"^ (■ • ■ (D"^ {{s{0/x})6) ■ (4))0) • • • • {h))6). 

By Remark 12.151 the definition above covers all possible cases. 

We are now able to define the differential A-theory generated by equating all differential A- 
terms having the same Taylor expansion. 

Definition 2.17 Given S,T € A'^ we say that NF{S*) = NF(r*) whenever ]<iF{S*) = T^iei^i' 
NF(T*) = J2jeJ^J '^'^^ there is an isomorphism l : I ^ J such that A/?"^ I~ = We set 

g = {{S,T) eA'^xA'^l NF{S*) = NF(r*)}. 

It is not difficult to check that 8 is actually a differential X-theory. 

Two usual A-terms s,t have the same Bohm tree [[3l Ch. 10] if, and only if, £ \- s = t holds. 
The 'if part of this equivalence is fairly straightforward, whereas the 'only if part is proved in 
[122). Thus, the theory £ can be seen as an extension of the theory of Bohm trees in the context 
of differential A-calculus. 



3. A Differential Model Theory 

In this section we will provide the categorical framework in which the models of the differential 
A-calculus live, namely, the Cartesian closed differential categoric^ The material presented in 
Subsection 13.11 is mainly borrowed from [[6]. 



^ These categories have been first introduced in [[12] (where they were caUed differential X-categories) and proposed 
as models of the simply typed differential A-calculus and simply typed resource calculus. 



What is a categorical model of the differential and the resource X-calculi? 



13 



3.1. Cartesian Differential Categories 

Differential A-terms will be interpreted as morphisms in a suitable category C. Since in the 
syntax we have sums of terms, we need a sum on the morphisms of C satisfying the equa- 
tions introduced in Notation 12.41 For this reason, we will focus our attention on left-additive 
categories. 

A category C is left-additive whenever each homset has a structure of commutative monoid 
{C{A,B),+ab,Oab) and {g + h) o f = [g o f) + [ho f) andOo/ = 0. 

Definition 3.1 A morphism f inC is said to be additive if, in addition, it satisfies fo{g + h) = 
{f°9) + {f°h) andfoO = 0. 

A category is Cartesian left- additive if it is a left- additive category with products such that 
all projections and pairings of additive maps are additive. 

Definition 3.2 A Cartesian differential category is a Cartesian left- additive category having 
an operator D{—) that maps a morphism f : A —?■ B into a morphism D{f) : A 'x A ^ B and 
satisfies the following axioms: 

Dl. D{f + g) = D{f) + D{g) and D{0) = 0, 

D2. D{f) o{h + k,v) = D{f) o (/i, v) + D{f) o (A;, v) and D{f) o (0, v) = 0, 

D3. D{ld) = TTl, D{tTi) = TTiOTTl and D (712) = TT2 0T^1, 

Dl Di{f,g)) = {Dif),D{g)), 

D5. D{fog) = D{f)o{D{g),g 0^2), 

D6. D{D{f)) o {{g, 0), {h, k)) = D{f) o (5, k), 

D7. D{DU)) o ((0, h), {g, k)) = D{DU)) o ((0, 5), {K k)). 

We try to provide some intuitions on these axioms. (Dl) says that the operator D{—) is linear; 
(D2) says that D{—) is additive in its first coordinate; (D3) and (D4) ask that D{—) behaves 
coherently with the product structure; (D5) is the usual chain rule; (D6) requires that D{f) is 
linear in its first component. (D7) states the independence of the order of "partial differentia- 
tion" . 



Remark 3.3 In a Cartesian differential category we obtain partial derivatives from the full 
ones by "zeroing out" the components on which the differentiation is not required. For example, 
suppose that we want to define the partial derivative Di{f) of f : C x A ^ B on its first 
component; then, it is sufficient to set Di{f) = o ((Idc, 0^) x IdcxA) : C x (C x A) ^ B. 

Similarly, we define I?2(/) = o ((Oc, Ma) x Idcx^l) ■ Ax {C x A) ^ B, the partial 

derivative of f on its second component. 

This remark follows since every differential D{f) can be reconstructed from its partial deriva- 
tives as follows: 

D{f)= D{f)o{{TTiOTTi,TT2 01Ti),TT2) 

= D{f)o {{m o vri, 0) , TT2) + D(f)o ((0, vra o vri) , vra) 

= D{f) O ((Id, 0) X Id) O (tTi X Id) + D{f) O ((0, Id) X Id) O {-K2 X Id) 

= I)i(/)o(7ri xId)+D2(/)o(7r2 xld). 
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3.2. Linear Morphisms 

In Cartesian differential categories we are able to express the fact that a morphism is 'linear' 
by asking that its differential is constant. 

Definition 3.4 In a Cartesian differential category, a morphism f : A B is called linear if 
Lemma 3.5 Every linear morphism f : A B is additive. 

Proof. By definition of linear morphism we have D{f) = f otti. For all g,h : C ^ A we have 

foig + h)= fo7rio{g + h,g)=Dif)o{g + h,g) = 

Dif)o{g,g) + D{f)o{h,g) = foTVio {g,g) + foTrio{h,g) = fog + foh 
Moreover / o = / o tti o (0, 0) = D{f)o (0, 0) = 0. We conclude that / is additive. ■ 

Lemma 3.6 The composition of two linear morphisms is linear. 

Proof. Let f,g be two linear maps. We have to prove that D(fog) = fogom. By (D5) 
we have D{f o g) = D{f) o {D{g),g 07^2) ■ Since f,g are linear we have D{f) o [D{g),g 01^2) = 
foTrio{goTri,goTT2)=fogoTTi. ■ 

Thus, in fact, every Cartesian differential category has a subcategory of linear maps. 

3.3. Cartesian Closed Differential Categories 

Cartesian differential categories are not enough to interpret the differential A-calculus, since 
the differential operator does not behave automatically well with respect to the Cartesian closed 
structure. For this reason we now introduce the notion of Cartesian closed differential category. 

Definition 3.7 A category is Cartesian closed left-additive if it is a Cartesian left-additive 
category which is Cartesian closed and satisfies: 

(+-curry) A{f + g) = A{f) + A{g) A(0) = (0-curry) 

From these properties of A(— ) we can easily prove that the evaluation morphism is additive in 
its left component. 

Lemma 3.8 In every Cartesian closed left-additive category the following axioms hold (for all 
f,g:C^ [A^B] and h : C ^ A): 

(+- eval) ev o (/ + g^ h) = ev o (/, /i) + ev o h) ev o (0, h) = (0-eval) 

Proof. Let /' = A~(/) and g' = A~{g). Then wc have: 

ewo{f + g,h) =evo((A(/') + A(5')) xId)o(Id,/i) by dcf. of 

= A-((A(/') + A{g')) o (Id, h) by def. of A" 

= A-(A(/' + g')) o (Id, h) by (+-curry) 

= (/' + g') o (Id, h) by def. of A" 

= /' o (Id ,h) + g'o (Id , h) by left-additivity 

= A-(/) o (Id, h) + A-{g) o (Id, h) by def. of f,g' 
= evo (/ X Id) o (Id, h) +evo{g X Id) o (Id, h) by def. of A~ 
= evo(/, h) -\-evo{g,h) 

Moreover ev o (0, g) = evo (A(0) ,g) = Oo{ld,g)=0. m 
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Definition 3.9 A Cartesian closed differential category is a Cartesian differential category 
which is Cartesian closed left-additive and such that, for all f : C x A ^ B: 

(D-curry) D{A{f)) = A{D{f) o (tti x Oa, ^2 x Ma)). 

Indeed, in a Cartesian closed differential category we have two ways to derivate f : C xA ^ B 
in its first component: we can use the trick of Remark 13.31 or we can 'hide' the component A 
by currying / and then derive A(/). Intuitively, (D-curry) requires that these two methods are 
equivalent. 

Lemma 3.10 In every Cartesian closed differential category the following axiom holds (for all 
h:C^ [A^B] andg:C-^ A): 

(D-eval) D{evo{h,g))=evo{D{h),goTT2) + D{A-{h))o{{0c,D{g)),{7T2,go7T2)) 

Proof. Let h' = A' (h) : C x A ^ B. Then we have: 

D{evo{h,g))= by def. of ^' 

DleYo {A{h'),g)) = by (beta-cat) 

Dih'o{ldc,g))= by(D5) 

D{h')o{D{{ldc,g)),{^dc,g)o7r2) = by (D4) and (D3) 

D{h') o {{-ni, D(g)) , {1^2, g °'^2)) = since pairing is additive 

D{h')o{{7ri,0A) + {0c,D{g)),{7r2,go7r2)) = by (D2) 
Dih') o ((vri, Oa), (7r2,5ovr2)) + D{h') o ((Oc, Dig)), (vra, govra)) = 
D{h')o{TTi X 0A,7r2 X IdA)o(IdcxC,5'0 7r2) 

+ D{h')o{{0c,D{g)),{n2,go7r2)) = by (beta-cat) 
evo(A(L»(/i')o(7ri x 0A,7r2 x IdA)),5'07r2) 

+ D{h')o{{0c,D{g)),{7r2,go7r2)) = by (D-curry) 
evo{DiA{h')),go7r2) + D{A-iA{h')))o{{0c,D{g)),{7T2,go7T2))= by def . of h' 
evo{D{h),go7T2)+D{A-{h))o{{0c,D{g)),{7:2,go7r2)) 



The axiom (D-eval) can be seen as a chain rule for denotations of differential A-terms (cf. 
Lemma 13.18( 1). below). 

In Cartesian closed differential categories we are able to define a binary operator -k on mor- 
phisms, that can be seen as the semantic counterpart of differential substitution. 

Definition 3.11 The operator 

f -.CxA^B g:C ^A 



f^g:CxA-^B 



(*) 



IS 



defined hyf*g = D{f)o ((og^^, 5 o ^1) , Id^x a) • 



The morphism f -k g is obtained by differentiating / in its second component, and applying g in 
that component. 

Remark 3.12 Actually the operators D[—) and -k are mutually definable. To define D{—) in 
terms of -k just set D{f) = {f 07^2) *Id. To check that this definition is meaningful we show 
that it holds in every Cartesian differential category: indeed, by Definition \3.11{ (/o7r2)*Id = 
-^^(/°'''"2) o ((0, VTi), Id) = D{f) o {tt2 ovTi, 7r2 o7r2) o ((0, TTi), Id) = D{f). Thus it would be possible 
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to formulate the whole theory of Cartesian closed differential categories by axiomatizing the 
behaviour of -k instead of that of D(—). In this work we prefer to use D{—) because it is a more 
basic operation, already studied in the literature, and the complexities of the two approaches are 
comparable. 

It is possible to characterize linear morphisms in terms of the operator * as follows. 
Lemma 3.13 A morphism f : A ^ B is linear iff for all g : C A: 

(/o7r2)*5 = {f°9)°T^i -.C X A-^ B 

Proof. (=^) Suppose that / is linear. By definition of * we have that {f 0112) *5 = D[f o 
T^2) ° {{^C ■, 9 ■ By applying (D5) and (D3), this is equal to £>(/) o (7r2 ovri, 7r2 o7r2) o 

((0c,5'O7ri),IdcxA) = D{f)o {go 1x1,1x2). Since / is linear we have D{f) = /ovri, thus D{f)o 

{901x1,1x2) = fogoTTi. 

(<^=) Suppose {f 01x2) * 9 = if °9)°'^i for all : C — )• A. In particular, this is true ioi C = A 
and g = Id^. Thus we have {f 01x2) ^Id^ = f °t^i- We conclude since: 

(/o7r2)*Id^= D{f 01x2)0 {{{)A:'Ki),ldAxA) by def. of * 

= ^(/)o(7r2o^i,^2o^2)o((0A,^i),IdAxA) by (D5)+(D3) 
= D{f)o{^^,^2) = D{f) 

■ 

The operator -k enjoys the following commutation property. 
Lemma 3.14 Let f : C x A ^ B and g,h : C ^ A. Then {f -k g) -k h = {f krh) k: g. 
Proof. We set cpg = {{Oc,goixi),ldcxA) and iph = {{Oc,hoixi),ldcxA)- We have: 



{fkg)kh = D{D{f)o{{Oc,goixi),ldcxA))oiph= by (D5) 

DiD{f)) o {D{{{Oc,g o TTi), Id)), ((Oc, o TTi), Id) o 1x2) oiph= by (D4) 

D{D{f))o{{{Qc,D{goix^)),ix^),{{Qc,9o^i)M)oT^2)o^h= by (D5) 
D{D{f)) o (((Oc, D{g) o {ixiOTXi, 1x101x2)), TXi), ((Oc, 5 otti). Id) o7r2) oLpf,= 

D{D{f))o{{{Oc,D{g)o{Oc,ni)),{Oc,hoixi)),{{Oc,goixi),ld)) = by (D2) 

DiDif))o{{0cxAA0c,hoixi)),{{0c,9O7Xi),ld)) = by (D7) 

I?(L>(/))o((0cxA,(0c,5o^i)),((0c,/iovri),Id)) = by (D2) 
D{D{f))o{{{0c,D{h)o{0c,7Xi)),{0c,9OTTi)),{{0c,hoixi),Id)) = 

D{D{f ))o{{{Oc,D{h)o {1x1 01x1, 1x1 o 1x2)), TTi), {{0c,hoixi),ld)oix2)oipg = by (D5) 

D(Z)(/))o(((0c,I)(/io7ri)),7ri),((0c,^o7ri),Id)o7r2)o^3= by (D4) 

DiD{f))o{D{{{0c,hoix,),ldcA)),{{0c,hoixi),ld)oix2)oipg = by (D5) 
D{D{f)o{{Oc,hoix^),ld))o^g = {fkh)kg 



Definition 3.15 Let swabc = ((^ri ovri, 7r2), 7r2 ovri) : {A x B) x C ^ {A x C) x B . 

Remark 3.16 swosw = Id(Ax_B)xC; swo {{f,g), h) = ((/, h),g) and D{sw) = swotti. 

The following two technical lemmas will be used in Subsection 14.31 to show the soundness of 
the categorical models of the differential A-calculus. The interested reader can find the whole 
proofs in the technical Appendix lAl 
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Lemma 3.17 Let f : {C x A) x D ^ B and g : C ^ A, h : C ^ B' . Then: 

(i) TT2-kg = gOTTl, 
(a) (/lOTTi) ★5 = 0, 

(Hi) A{f)-kg = A(((/osw) -k {goTTi))osw). 

Proof. (Outline) (i) follows by applying (D3). (ii) follows by applying (D2), (D3) and (D5). 
{Hi) follows by (Curry), (D-curry) and (D2), (D3), (D5). m 

Lemma 3.18 Let f : C x A ^ [D^B] and g : C ^ A, h : C x A D. Then: 

(i) (eYo{f,h))*g = eYo{f^g + A(A- (/) *{h*g)),h), 

(ii) A(A- (/) * /i) * 5 = A(A- {f^g)kh)+ A(A- (/) *{hkg)), 
(Hi) A(A- (/) * h) o {ldc,g) = A(A- (/ o (Idc, g))*{ho {Idc, g))). 

Proof. (Outline) (i) follows by applying (D-eval) and (beta-cat). 

(ii) This equation can be simplified by using the axioms of Cartesian closed left-additive 
categories. Indeed, the right side can be written as A((A~(/ -k g) -k h) + A~(/) -k {h-k g)). By 
taking a morphism /' such that / = A(/') and by applying Lemma \3A7i iii) the item (ii) 
becomes equivalent to ((/' * h) osw) -k (g o-ki) osw = (((/' osw) k: (goiri)) osw) k: h + f k: (hk g). 
This follows by (Curry) and (D2-7). 

(Hi) follows by (Curry) and (D2-5). ■ 

4. Categorical Models of the Differential Lambda Calculus 

In [[12] we have proved that Cartesian closed differential categories constitute sound models 
of the simply typed differential A-calculus. In this section we will show that all reflexive objects 
living in these categories and satisfying a linearity condition are sound models of the untyped 
version of this calculus. 

4.1. Linear Reflexive Objects in Cartesian Closed DifTerential Categories 

In a category C, an object ^ is a retract of an object B, written A <\ B,\i there are morphisms 
f : A ^ B and g : B A such that go f = Ua- When also f o g = Id^ holds we say that A 
and B are isomorphic, written A = B, and that f,g are isomorphisms. 

In a Cartesian closed category C a reflexive object ought to mean a triple (U, A, A) where 
U is an object of C and A : U ^ [U^U] and X : [U^U] ^ U are two morphisms performing 
the retraction [[/=>{/] < U. When [U ^U] = U we say that ^ is extensional. 

Definition 4.1 A reflexive object ^ = {U,A,X) in a Cartesian closed differential category is 
linear if both A and X are linear morphisms. 

We are now able to provide our definition of model of the untyped differential A-calculus. 

Definition 4.2 A categorical model ^ of the differential A-calculus is a linear reflexive object 
in a Cartesian closed differential category. The model is called extensional if the reflexive 
object is extensional (i.e., [U^U] = U). 
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The following lemma is useful for proving that a reflexive object in a Cartesian closed differ- 
ential category is linear. 

Lemma 4.3 Let be a reflexive object. 

(i) If A and \ oA are linear then ^ is linear. 

(a) If is extensional and either A or A are linear then ^ is linear. 

Proof, (i) Suppose A and Ao^ are linear morphisms. We now show that also A is linear. Indeed 
we have: 

D[\)= Z)(A)o(^ X ^)o(A X A) = D(A)o(^o7ri,^o7r2)o(A X A) = by ^ linear 

= L>(A)o(L)(^),^o7r2)o(A X A) = i:>(Ao^)o(A X A) = by Ao^ linear 

= Ao^OTTi O (AoVTi, Ao7r2) = Ao^oAoTTi = AoVTi. 

(ii) If A is linear then it follows directly from (i) since Ao^ = Idj; and the identity is linear. 
If A is linear, calculations analogous to those made in (i) show that also A is. ■ 

Notice that, in general, there may be extensional reflexive objects that are not linear. However, 
in the concrete example of Cartesian closed differential category we will provide in Section [5] 
every extensional reflexive object will be linear (see Corollarv l5.6p . 

Lemma 4.4 Let be a linear reflexive object and let f : \U ^U], h : [/"■"'"^ U 

g:U'' ^U. Then: 

(i) \o{f-kg) = {\of)-kg, 

(ii) Ao(h-kg) = {Aoh)-kg. 

Proof, (z) By definition of * we have {Xof)-kg = Z)(Ao/) o ((0[/n,(7O7ri),Idf/n+i). By (D5) 
we have D{Xof) = D{X) o {D{f)., f 01^2) . Since A is linear we have -D(A) = Aotti, thus D{X)o 
(£>(/), /ovra) = Ao7rio(Z)(/),/o7r2) = AoD(/). Hence, D(A o /) o ((Of/n, 50^1), Idf;„+i) = 
AoD(/)o((0c/n,go7ri),Idc7n+i) = \o{f -kg), 
{ii) Analogous to {i). ■ 

4.2. Defining the Interpretation 

Let X = xi, . . . ,Xn be an ordered sequence of variables without repetitions. We say that x 
is adequate for S*!, . . . , 5^ G A*^ if FV(5i, . . . , Sk) C {xi, . . . , x„}. Given an object U we write 
for the {xi, . . . ,x„}-indexed categorical product of n copies of U (when n = we consider 
= !)• Moreover, we define the i-th projection vrf : ^ U by 

^ _ J 7r2 if i = n, 

* 1 7rf ^''"'^""^ ovTi otherwise. 

Definition 4.5 Let ^ be a categorical model, S be a differential X-term and x = xi, . . . ,Xn be 
adequate for S. The interpretation of 5 in ^ (with respect to x) will be a morphism IS}^ : 
— > U defined by induction as follows: 

• lxih = ^i> 

• m, = evo{Aolsl„lTy, 
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• [Az.s]]^ = Ao A(|[s]]^^), where by a-conversion we suppose that z does not occur in x, 
. s • (t)L. = A o A(A- {A o M^) * PL.), 

. [D"+is ■ (ti, . . . ,tn,tn+i)L- = AoA(A"Mo[D"s • (ti, . . . ,t„)y * ttWiy. 
Remark 4.6 i^asy calculations give 

ID^s • (ii, . . . = Ao A((. • • (A-(^o[sy ^ . . . ) * [tny . 

Lemma \3.14\ entails that this interpretation does not depend on the chosen representative of 
the permutative equivalence class. In other words, we have |[D"s • {ti, . . . ,tn)i^ = [[D"s • 
. . . ,ta(n))L for every permutation E 6„. 

4.3. Soundness 

Given a categorical model we can define the equational theory of ^ as follows: 

Th(^) = {S = T\ \S\^ = [ry for some x adequate for 5, T}. 

The aim of this section is to prove that the interpretation we have defined is sound, i.e., that 
Th('^) is a differential A-theory for every model 

The following convention allows us to lighten the statements of our theorems. 

Convention 4.7 Hereafter, and until the end of the section, we consider a fixed (but arbitrary) 
linear reflexive object living in a Cartesian closed differential category C. Moreover, whenever 
we write IS^^, we suppose that x is an adequate sequence for S. 

The proof of the next lemma is easy, and it is left to the reader. Recall that the morphism 
sw has been introduced in Definition 13. 151 

Lemma 4.8 Let S € A'^. 

(i) If z ^ FV(S') then IS}^.^ = [S'l^oTri, where z does not occur in x, 
(ii) \S\g.y.^ = \S\^.z.y°sw , where z and y do not occur in x. 

Theorem 4.9 (Classic Substitution Theorem) Let S,T ^ A'^, x = xi, . . . ,Xn and y not occur- 
ring in X. Then: 

lS{T/y}h = lSU^yO{U,lTU. 

Proof. By induction on S. The only interesting case is 5 = D"s • {ui, . . . ,Un)- we treat it by 
cases on n. 

Case n = 1. By definition of substitution we have [(Ds • iii){T/y}]]^ = [IDs{r/?/} • iti{T/y}|-. 
By definition of |[-| this is equal to AoA(A~(^o|[s{r/y}y ★[[ui{T/y}y . By induction hypoth- 
esis we get AoA(A-(^o[sL.j^o(Id,[ry)*([niL.j^o(Id,[ry)). By applying LemmaEUm) 
this is equal to Ao A(A-(^o * [ml-,) o (Id,' [TL.) = [Ds • uij^.^ o (Id, IT^. 

Case n > 1. By definition of substitution we have |[(D"s- (ui, . . . , Un)){T/y}}^ = [I(D"'s{r/y}- 
{ui{T/y}, . . . ,Un{T/y}))l^. Applying the definition of [ — ]] this is equal to AoA(A~(^o 
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[D"-i s{T/y} ■ MT/y}, u„-i{T/y})|.) * lun{T/y}y. By definition of substitution this is 
AoA(A"(^o[(D"-is-(ni, . . . ,Un-i)){T/y}}^)^Un{T/y}y. By Applying the induction hypoth- 
esis twice we get AoA(A-(^o[(D«-is • (m, . . . , n„_i)L-,,°ad, 1^1^-)) * (KI^^o (Id, [Ty)). By 
LemmaEHin) this is equal to Ao A(A-(>lo[D'^-i s ■ {ui, * KLj/)° (W, [TJ.) = 

[(D-s-(ni,...,«„))L.^o(id,[ry. ■ 

Theorem 4.10 (Differential Substitution Theorem) Let 5, T € A*^, x = xi, . . . ,Xn and y not 
occurring in x. Then: 

If • Th,y = IShy * ITh- 

Proof. By structural induction on 5. 

. case S ^ y. Then [| • T^.^^ = [T^^,^ = [T^^ o vri = tt^ * IT}. = M^.^^ * IT}, by 
Lemma I3.17r i) . 

• case S = Xi y. Then • ^J^^ = |[0|-^ = 0. By Lemma E1Z1^«^) we have = 

• case S = Xz.v. By definition of differential substitution we have that [j ^^^-" ■T}.^ = ^Xz.^- 

n,,y = AoA([| .rL^,,,J. Applying Lemma SSIii), this is equal to AoA([[| ■ rL^,,,,osw). 
By induction hypothesis we obtain AoA((|[u|^^ ^-k [[r|^^)osw). Supposing without loss of 
generality that z ^ FV(r) we have, by Lemma HTST i). [Tl^^ = [TJ^ovn. Thus, applying 
Lemma |3. 17f iii) . we have that 

A°A(([^L>,,*(ttrL°^i))°sw) = Ao(A(H.>,,osw)*[ry 

which is equal to Ao(A([[f]]^y ^) * [T]]^) by Lemma H^ ii). Since ^ is linear, we can apply 
Lemma liai^i) and get Xo{A(lvh,y,z) * tt^L^) = i>^°Mlvh,yJ) * tt^L^ = l^^-^hy * tt^L- 

• case S = sU. By definition of differential substitution we have that l^§^ ■ T}.^ = |[(|| • 

y + K'-^'^ ■ ■ J/- consider the two addenda componentwise. On the 

one side we have |[(|| • T)U}.^y = evo (^o|[|| • Tj.^y, lUj.^y) which is equal, by induction 
hypothesis, to ev o (l4o ([sj^^ * [[T|^), [C/]]^^). By Lemma l4.4r ii) this is equal to ev o 
{i^°ls}.J*lT}.,lU}.J. 

On the other side we have (using ^oA = Idu^u): 

liDs . (f • T))U},^y = evo (A(A-(^o [.y^) * [f • T},^), IU},J, 
by induction hypothesis this is equal to 

evo (A(A-(^o [.I^.^^) ^ {lU},^y * IT},)), IT}, J. 
By applying Lemma 13.81 we can rewrite the sum of this two addenda as follows: 

evo ((^o * IT}, + A(A-(^o [,sL.^) * ([C/L^,, * IT},)), lU},^^). 

By LemmaEUKi) this is (evo (^o [sj.^, IU},J) * IT}, = IsU},^^ * IT},. 
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• case S = D^v ■ {ui, . . . By cases on n. 

Subcase n = 1. By definition of differential substitution, we liave 

Consider tlie two addenda separately. On the one side we have [1D(|| • T) ■ uil^y = 

XoA{A~ (Aol^ ■Tl^y)-kluij^y). By the inductive hypothesis this is equal to AoA(A"(^o 

ilvhy * ITh)) * l^ihy)^ which is equal to A o A(A-((^ o H,^,,) * ITh) * 1^1^^^^) by 
Lemma \AA( ii). 

On the other side, we have that [D^; • • T)}.^^ = Ao A(A- (^o Ivj^J * • Tj.^y). By 
induction hypothesis this is Ao A(A-(^o ^ ([liil^^j^ * II^D)- 

Since A is linear, we can apply Lemma |3 . 1 3 1 and write the sum of the two morphisms as: 
Ao (A(A-(Mo H^.^^) * [TL.) * lm},^y) + A{A-{Aolvh^y) * ([mL.^ * [Ty )). 

By applying Lemma \3.l8[ ii). we obtain Ao {A{A^ {A o Ivjg y) -k [uil^y) * ITj^) which is 
equalto [Dr;-nil.^*[ri.. 

Subcase n > 1. Performing easy calculations we get [^(D""!; • {ui, . . . ,Un)) ■ Tj^.y = 
[D(^(D"-1t; . {u,, . . .,un-i)) ■ T) ■ unh^y + [D(D«-i^; • (J, . . . • • T)Uy. We 

consider the two addenda separately: 

(1) XoA{A-{Aol-§^iD^-^vim,...,Un-i))-Ti.^y)*lunh,y)= bylH 

Ao A(A-(^o ([D«-it; • (m, . . .,un-i)hy* iTh)) * KLy) = by Lemma Sa^ii) 

Ao A(A-((^o [D"-!^; • (m, . . .,u^-i)hj * [Ty * ^y^). 

(2) Ao A(A-(^o [D"-it; • (m, . . . ,n„_i)y^) * • Ty^) = by IH 
Ao A(A-(^o [D--i^ • (ni, . . . , ^x„^i)L^,,) * (Kk, * tt^y)- 

Since A is linear, we have that (1) + (2) is equal to 

A o(A(A-((^o[D"-iT;.(ni,...,u„_i)y^)*[ry + 

A(A-Mo[D"-l7; ■ (ui, . . .,Un-l)h,y) * ihnh,y * iTj,))) 

By LemmaEHii) we get A o (A(A-(^o [D^-i^; • (ui, Tx^.^y^) * Mx) * [Ty. By 
Lemma Sai^i) this is equal to Ao A(A- (^o ID^-^^v (ui, . . . , Un-i)jgy) * [ln„]]^) ★ [[r|^, i.e., 
tolD^v{u,,...,Un)h,y*m^. 

• all other cases {i.e., S = and S = s + U) are straightforward. 



We are now able to provide the main result of this section. 

Theorem 4.11 (Soundness) Every reflexive object ^ in a Cartesian closed differential category 
C is a sound model of the differential X-calculus. 

Proof. It is easy to check that the categorical interpretation is contextual. We now prove that 
Th('^) is closed under the rules (/3) and {/3d) 
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• (/3) Let |[(Ay.s)r|. = ev o (^oAo A(|[s]]-^), [Ty . Since ^oA = Id this is equal to 
ev o {AilshJ, ITU. On the other side we have MT/y}^. = [sL^,, o (Id, IT}.) by the 
Theorem island, by (beta-cat), o (Id, [Ty = evo (A([sl.,,), [TI.). 

• {/3n) Let [[D(Ay.s)-% = AoA(A-(^oAoA([[sy ,^))*|[t|.). Since ^oA = Id this is equal to 
Ao A(A-(A([sI.y)) * = XoAilsjgy* Ity. By applying Theorem (HOl this is equal 
toAoA([|.%J = [Ay.|.ty 

We conclude that Th(^ ) is a differential A-theory. ■ 

The above theorem shows that linear reflexive objects in Cartesian closed differential categories 
are sound models of the untyped differential A-calculus; it is not known at the moment whether 
this notion of model is also complete (i.e., whether for every differential A-theory T there is a 
linear reflexive object '^j- living in a suitable Cartesian closed differential category Cj- such that 
Th('^) = T). The problem of completeness will be discussed in Subsection 17.21 

Proposition 4.12 If ^ is extensional, then Th('^) is extensional. 

Proof. Like in the case of usual A-calculus, easy calculations show that |[Ax.sx|^ = Ao A(ev) o 
^ojs]]^ which is equal to since A(ev) = Id and Ao^ = Id. ■ 

4.3.1. Comparison with the Categorical Models of the Untyped Lambda Calculus 

The definition of categorical model of the differential A-calculus proposed in this paper seems 
to be a generalization without surprises of the classical definition of model of the A-calculus, i.e., 
the notion of reflexive object in a Cartesian closed category. However, while this notion is - by 
far - the most famous categorical definition of model of A-calculus, it is not the most general 
one. Indeed, as pointed out by Martini in [[29], in the proof of soundness [[3l Prop. 5.5.5] for 
categorical models there is one axiom of Cartesian closed categories that is never used, namely 
the axiom (Id-Curry) which is equivalent to ask for the unicity of the operator A(— ) in the 
category (and this entails A(A~(/)) = /). 

For this reason Martini proposed reflexive objects living in weak Cartesian closed categories 
as a more general notion of model of A-calculus. In these categories we have just a retraction 
(not an isomorphism) between the homsets C(C x A,B) <\ C{C,A^B). Thus A^B is no 
longer an object representing exactly C{A, B) — there are different objects that can equally well 
accomplish the job. Recently, De Carvalho [[IT] successfully used this notion to build concrete 
models living in very natural weak Cartesian closed categories inspired from the semantics of 
linear logic. 

In our differential framework this generalization cannot be applied since the proof of soundness 
relies on the fact that A(A~(/)) = /. This is actually needed to give a meaningful interpretation 
of the linear application Ds ■ t. Hence the definition of categorical model of the differential A- 
calculus differs from the corresponding one for the usual A-calculus more than one could imagine 
at a first look. 

4.4. Modeling the Taylor Expansion 

In this subsection we provide sufficient conditions for models living in Cartesian closed differ- 
ential categories to equate all terms having the same Taylor expansion. As an interesting fact, 
this happens to be a property of the category rather than of the reflexive objects. Therefore, all 
models living in a category "modeling the Taylor expansion" have an equational theory including 
S. 
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Since the definition of tlie Taylor expansion asks for infinite sums, we need to consider Carte- 
sian closed differential categories C where it is possible to sum infinitely many morphisms. 
Formally, we require that for every countable set / and every family of morphisms 

fi'.A—^Bwe have ^^^j fi G C{A,B). In this case we say that C has countable sums. To 
avoid the tedious problem of handling coefficients we suppose that the sum on the morphisms 
is idempotent. 

Definition 4.13 A Cartesian closed differential category models the Taylor Expansion if it has 
countable sums and the following axiom holds (for every f : C x A B and g : C A): 

(Taylor) evo{f,g) = V ((• • • (A-(/) • • • ) * 9) « (M, 0). 

k times 

Recall that the Taylor expansion S* of a differential A-term S has been defined in Subsec- 
tion 12.41 Given a model ^ of the differential A-calculus living in a Cartesian closed differential 
category having countable sums we can extend the interpretation given in Definition to terms 
in AJ^ by setting pjg/Sj]]^ = J2iei l^ilx^ every countable set /. 

Theorem 4.14 Let S be a differential X-term and be a model living in a Cartesian closed 
differential category having countable sums and modeling the Taylor Expansion. Then: 

ish = is*j,. 

Proof. By structural induction on 5. The only interesting case is 5 = sT. 

= ev o o IsU ITU by def . of [ - 

= Eke^ii- ■ ■ (A-(^o |,sl.) ^Tl,) m,) o (Id, 0) by (Taylor) 

V ' 

k times 

= EfceAT evo (A((. . . {A-{lsl,4Tl,) ■■■)* iTj,), 0) by (beta-cat) 

k times 

= EfceA^evo (^oAo A((. ■ ■ (A-^^L^^ry • • • ) * tt^y ,0) by A = Id 

k times 

= EfcgArevo(^o[D^s-(r,...,r)yO) by def. of [-l^ 

= [Efce^(D^s.(r,...,r))Ol. by def. of 1-1. 

= lisTTh bydef.of(-)* 

■ 

By adapting the proof of Theorem 14.111 one can prove that IS*}^ = |[NF(5*)]]^ for every 
differential A-term S. From this fact and Theorem 14. 141 we get the following result. 

Corollary 4.15 Every model ^ living in a Cartesian closed differential category that models 
the Taylor expansion satisfies 8 C Th('^). 

5. A Relational Model of the Differential Lambda Calculus 

In this section we provide the main example of Cartesian closed differential category known 
in the literature. What we have in mind is the category MRel [ 1251 HO] - which is the co-Kleisli 
category of the functor ^Af{—) over the ^-autonomous category Rel of sets and relations. We 
will also show that the reflexive object Si living in MRel built in [ [10] to model the usual A- 
calculus is linear, and then it constitutes a model of the untyped differential A-calculus. We will 
then provide a partial characterization of its equational theory showing that it contains Xfirj'^ 
and £ (this follows from the fact that MRel models the Taylor expansion). 
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Remark 5.1 In / 12] we have provided another example of Cartesian closed differential category: 
the category MFin, which is the co-Kleisli of the functor Ai f{—) over the -k- autonomous category 
of finiteness spaces and finitary relations /ITP)/. In this paper we do not present the category 
MFin since it does not contain any reflexive object (see [\T^ \3EI) and hence it cannot he used 
as a semantics of the untyped differential X-calculus. Other examples of semantics useful for 
modeling the untyped differential X-calculus (including semantics that do not model the Taylor 
expansion) will be discussed in Subsection ]?. 1\ 

5.1. Relational Semantics 

We recall that the definitions and notations concerning multisets have been introduced in 
Subsection 11.11 We now provide a direct definition of the category IVIRel: 

• The objects of MRel are all the sets. 

• A morphism from A to B is a relation from A4f{A) to B; in other words, MRel(j4, B) = 
V{MfiA) X B). 

• The identity of A is the relation Id^ = {{[a],a) \ a £ A} £ MRel(A, A). 

• The composition of s e MRel(A, B) and t G MRel(S, C) is defined by: 

tos = {(m,7) I B/c E TV 3(mi, (mfc, /3fc) G s such that 
m = mi tt) . . . 1+) mfe and . . . ,/3fe],7) G t}. 

Given two sets Ai,A2, we denote by Ai h,A2 their disjoint union ({1} x ^i) U ({2} x A2). 
Hereafter we adopt the following convention. 

Convention 5.2 We consider the canonical bisection between M.f(^A\) y. Mji^A'i) and A^/(j4i&: 
A2) as an equality. Therefore, we will still denote by (mi, 777.2) the corresponding element of 
MfiAikAi). 

Theorem 5.3 The category MRel is a Cartesian closed category. 

Proof. The terminal object 1 is the empty set 0, and the unique element of MRel(A, 0) is the 
empty relation. 

Given two sets Ai and A2, their categorical product in MRel is their disjoint union AikA2 
and the projections 7ri,7r2 are given by: 

TTj = {{[{i,a)],a) \ ae Ai} £ MRel{Ai kA2, Ai), for i = 1,2. 

It is easy to check that this is actually the categorical product of Ai and A2 in IVERel; given 
s G MRel(B, ^1) and t £ MRel{B, A2), the corresponding morphism (s, t) £ MRel{B, Ai kA2) 
is given by: 

(s, t) = {{m, (1, a)) I (m, a) £ s} U {{m, (2, 6)) | (m, b) £ t} . 

Given two objects A and B, the exponential object A^B is A4f{A) x B and the evaluation 
morphism is given by: 

evAB = {(([(m,6)],m),6) | m £ Mf{A) and b £ B} £ MRel{[A^ B]kA, B) . 

Again, it is easy to check that in this way we defined an exponentiation. Indeed, given any set C 
and any morphism s £ MRel(C&^, i?), there is exactly one morphism A(s) £ MRe^C, A^ B) 
such that: 

ev^Bo(A(s) X Ids) = s. 
which is A(s) = {(p, (m, 6)) | {{p,m),b) £ s}. ■ 
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Theorem 5.4 The category MRel is a Cartesian closed differential category. 

Proof. By Theorem 15 . 31 MRel is Cartesian closed. It is Cartesian closed left-additive since every 
homset 'MRel{A, B) can be endowed with the following additive structure (MRel(A, i?), U, 0). 
Finally, given / G Affi,el(yl, B) we can define its derivative as follows: 

D{f) = {(([a],m),/3) | (mW [a],/3) G /} G MRel{AkA,B). 

It is not difficult to check that D{—) satisfies (Dl-7). We now show that also (D-curry) holds. 
Let / C {Mf{C) X Mf{A)) x B. On the one side we have: 

^(A(/)) = {(([7],mi),(m2,/3)) I ((miW[7],m2),/3)G/}. 

On the other side we have D{f) = /i U /2, where: 

/i = {(((M, []),(mi,m2)),/3) I ((mi W [7],m2),/3) G /}, 
/2 = {((([],[«]), (mi, m2)),/3) I ((mi,m2a[a]),/3) G/}. 

Since MRel is left-additive we have that 

(/i U /2) o (vTi X 0, 7r2 X Id) = (/i o (vri x 0, 7r2 x Id)) U (/2 o (vri x 0, 7r2 x Id)) 

Easy calculations give: 

/io(7ri X 0,^2 X Id) = {((([7],mi),m2),/3)) | ((mi W [71,^2),/?) G /} 
/2 O (vTi X 0, 7r2 X Id) = 0. 

We then get A(D(/)o(7ri x 0,7r2 x Id)) = A(/i o (vri x 0,7r2 x Id)) = D{A{f)). m 
The operator -k can be directly defined in IVIRel as follows: 

firg = {((mi am2,m),/3) | (mi, a) G g, ((m2,mtt) [a]),/3) G /} G MRel{CkA,B). 

We now provide a characterization of the linear morphisms of MRel. 

Lemma 5.5 A morphism f G MR,el{A, B) is linear iff for all (m, /3) ^ f we have that m is a 
singleton. 

Proof. Easy calculations give /ovri = {((m, []),/3) | {m, (3) G /}. This is equal to D{f) if and 
only if m is a singleton. ■ 

Corollary 5.6 In MRel every isomorphism is linear. 

Proof. Let / G MRel{B,A) and g G MRel{A,B) such that fog = Ha and gof = Ub- Notice 
that / does not contain any pair ([],«) because otherwise such a pair would also appear in fog^ 
and this is impossible since fog = Id. Similarly, g cannot contain any pair ([],/?). Thus: 

/05 = {([«],«) I 3(3 eB {[a], 13) eg and ([/?], a) G/}. 

Since by hypothesis /o^ = {([a], a) | a G A} we have that for all a G ^ there is a /? G i? such 
that ([/?], a) G /. Suppose now, by the way of contradiction, that there is a ([ai, . . . , Uk], (3) G g 
such that fc > 1. From the property above there are /3i, . . . , G -B such that ([/3j],aj) G / for 
1 < i < A:, thus we would have ([/3i, . . . , (3k], (3) G f°g = Ids, which is impossible. By Lemma [531 
we conclude that g is linear. Analogous considerations show that also / is linear. ■ 
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5.1.1. An Extensional Relational Model 

In this section we build a reflexive object & in MRel which is extensional by construction, 
and hence linear by Corollarv 15.61 We first give some preliminary definitions. 

Recall that TV denotes the set of natural numbers. An A/'-indexed sequence a = (mi, m2, . . .) 
of multisets is quasi-finite if rrii = [] holds for all but a finite number of indices i. If A is a set, 
we denote by A4f{X)^^'> the set of all quasi-finite A/'-indexed sequences of finite multisets over 
X. Notice that the only inhabitant of A4f{X)^'^^ is the sequence ([], [], [], . . .). 

We now define a family of sets {Dn}nGAf as follows: 

• A = 0, 

. = A(/(Z)„)H. 

Since the operation S i— t- Aif{S)^^^ is monotonic on sets, and since Dq C Di, we have 
Dn ^ Dn+i for all n € Af. Finally, we set D = U„g_/^-D„. 

So we have Dq = % and Di = {([],[],...)}. The elements of D2 are quasi-finite sequences of 
multisets over a singleton, i.e., quasi-finite sequences of natural numbers. More generally, an 
element of D can be represented as a finite tree which alternates two kinds of layers: 

• ordered nodes (the quasi- finite sequences), where immediate subtrees are indexed by dis- 
tinct natural numbers, 

• unordered nodes where subtrees are organized in a non-empty multiset. 

In order to define an isomorphism in MRel between D and [D=^D] = Mf{D) x D it is enough 
to remark that every element a G D is canonically associated with the pair (cjo, (ai, cr2, . . .)) and 
vice versa. Given a G D and m € A4f{D), we write m :: a for the element r = (ri, r2, . . .) € -D 
such that Ti = m and Tj^-i = cjj. This defines a bijection between Aif{D) x D and D, and hence 
an isomorphism in MRel as follows: 

Proposition 5.7 The triple 3> = {D,A,X) where: 

• A = {([(m,cj)],m :: a) \ m £Mf{D),a G L>} G MRel{D^D,D), 

• A = {([m :: a],{m,a)) \ m £ Mf{D),a e D} G MRel(i:>, L>^L>), 
is an extensional categorical model of differential \- calculus. 

Proof. It is trivial that Ao^ = Id^i and ^oA = Id^D^Dy We conclude by Corollarv 15.61 ■ 

5.2. Interpreting the Differential Lambda Calculus in & 

In Section [U we have defined the interpretation of a differential A-term in any linear reflexive 
object of a Cartesian closed differential category. We provide the result of the corresponding 
computation, when it is performed in Si. 

Given a differential A-term S and a sequence x = xi, . . . , adequate for 5, the interpretation 
[5]]. is an element of MRel(D^, D), i.e., [5]]. C Mf{DY x D. The interpretation is defined 
by structural induction on S as follows: 

• \^iix ~ {(([]' ••• 1 []i H> []'••• ) I ^ ^ where the only non-empty multiset occurs 
in the i-th position. 
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• lsTjg = {{{mi,...,mn),a) \ 3k £ M 

3{m{,...,mi) £Mf{DY for j = 0, . . . , A; 

3(7i, . . . ,ak & D such that 

rrii = l+l ... tt) for i = 1, . . . , n 

((m?,...,m°),[CTi,...,crfc] :: a) G [sj. 

{{m{, mi),aj) G [[r|^ for j = 1, . . . , /c}, 

• [Az.s]]^ = {((mi, . . . , m„), m :: (t) | ((mi, m„, m), (t) G [[s]]^^}, where we assume that 
z does not occur in x, 

• [D^s • (t)]]^ = {((mi tt)mi,...,m„ am^),m :: (3) \ 3a £ D ((mi, . . . , m„), a) G [t]]^ and 
((m'i,...,m;),ma [a] :: /3) G [sy, 

• [ID"+is-(ti,...,t„+i)|^ = {((mittlm'i,. . . ,m„ttJm[j),m :: I3)\3a£ D ((mi,. . . ,m„),a) G 
[Wil^and {{m[,...,m'J,miS[a] :: /3) G [D"s • (ti, . . . , t^)].}, 

• [OL^ = 0, 

• b + sj, = isj,uisi,. 

Note that if M is a closed differential A-term then [[M| C D. Moreover, it is easy to check that 
[OJ = (actually from [ [27j we know that the interpretation of all unsolvable ordinary A-terms 
is empty). In the next subsection we will prove some general properties of Th(^). 

5.3. An Extensional Model of Taylor Expansion 

In [ 27J we characterized the equational theory of seen as a model of the pure untyped 
A-calculus. More precisely we proved that Th(i^) = H*, the theory equating two A-terms M,N 
whenever they behave in the same way in every context. This is not surprising since Ehrhard 
proved in [[20] that the continuous semantics [[34] can be seen as the extensional collapse of the 
category MRel and that ^ corresponds to Scott's under this collapse. 

In this subsection we give a partial characterization of the theory of & seen as a model of the 
differential A-calculus. 

Remark 5.8 Given an arbitrary set I and an I -indexed family of relations {/i}jg/ from Aif{A) 
to B we have that Ui^jfi C Mj-[A) x B. In particular, IVIRel has countable sums. 

Proposition 5.9 MRel models the Taylor expansion. 

Proof. Let / C Mf{C) x {Mf{A) x B) and g C Mf{C) x A. Easy calculations give: 
evo(/,5r)= {(m,7) I 3/c G A/" 



3m j eMfiC) 


for j = 0, . . 


.,k 


3ai, ... ,ak £ A 


such that 




m = mo 1+) . . . tt) mk 


for i = 1, . . 


.,n 


(mo, ([ai, . . . ,afc],7)) G / 






imj,aj) G g 


for j = 1, . 


..,k} 


UgA/IKt) 1 3mjeMf{C) 


for j = 0, . . 


.,k 


3ai, ... ,ak £ A 


such that 




m = mo tt) . . . tt) mfc 


for i = 1, . . 


.,n 


(mo, ([ai, . . . ,afc],7)) G / 






{mj,aj) G g 


for J = 1, . 


..,k} 



= EfcgAr((---(A-(/) ,*g)--O^g )o(IdA,0) 

k times 
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Corollary 5.10 Every categorical model of the differential X-calculus living in MRel satisfies 
£ C Th(^). 

Corollary 5.11 The theory of ^ includes both Xf3r]'^ and £. 

Conjecture 1 We conjecture that 

Th(^) = {{S,T) gA'^ X A'^ \ for all contexts C(-), C{S) is solvable iffC{T) is solvable }, 

where a context is a differential X-term with a hole denoted by (•), and C{S) denotes the result 
of substituting S (possiblly with capture of variables) for the hole in C. 'Solvable' here has to 
be intended as may-solvabl^ (i.e., a sum of terms converges if at least one of its components 
converges). 

A complete syntactical characterization of the theory of & is difficult to provide, and it is kept 
for future works. 



6. The Resource Calculus 

In this section we present the resource calculus [ 7, 8j (using the formalization a la Tranquilli 
given in [ [31] ) and we show that every model of the differential A-calculus is also a model of 
the resource calculus. We then discuss the (tight) relationship existing between the differential 
A-calculus and the resource calculus. 

6.1. Its Syntax 

The resource calculus has three syntactical categories: resource X-terms (A*") that are in 
functional position; bags (A'') that are in argument position and represent multisets of resources, 
and sums that represent the possible results of a computation. A resource (A^'^) can be linear 
or intuitionistic, in the latter case it is written with a ! apex. An expression (A^''^) is either a 
term or a bag. 

Formally, we have the following grammar: 

A*" : M,N,L ::= x | Ax.M | MP resource A-terms 

resources 

A'': P,Q,R ::= [mP,...,mP] bags 
A(*) : A,B ::= M\P expressions 

Hereafter, resource A-terms are considered up to a-conversion and permutation of resources 
in the bags. Intuitively, linear resources are available exactly once, while banged resources zero 
or many times. 

Definition 6.1 Given an expression A the set FV{A) of free variables of A is defined by in- 
duction on A as follows: 

• FV(x) = {x}, 

• FV(Ax.M) = FV(M) - {x}, 



* May and must solvability have been studied in [ '3IJ' in the context of the resource calculus. 
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• FV(MP) = FV(M) U FV(P), 

• FV([]) = 0, 

• FV([M(')] tt) P) = FV(M) U FV(P). 

Given expressions Ai,...,Ak we set FV(^i, ...,Ak) = FV(Ai) U • • • U FV(Afc). 

Concerning sums, AA(A''') (resp. J\f{A^)) denotes the set of finite formal sums of terms (resp. 
bags). As usual, we suppose that the sum is commutative and associative, and that is its 
neutral element. 



M,NgA/'(A'') P,qGA/'(A^) A,B,CgA/'(A(^)) =A/'(A^)uA/'(A('')) 



sums 



Note that in writing J\f{A^^^) we are abusing the notation, as it does not denote the A/"- module 
generated over A^^^ = A'' U A^ but rather the union of the two AA-modules. In other words, sums 
must be taken only in the same sort. 

The definition of FV(-) is extended to elements of J\f{A^^^) in the obvious way. 

In the grammar for resource A-terms and bags sums do not appear, indeed in this calculus 
they may arise only on the "surface" (while in the differential A-calculus sums may appear in the 
right argument of an application). Nevertheless, as a syntactic sugar and not as actual syntax, 
we extend all the constructors to sums as follows. 

Notation 6.2 We set the following abbreviations on J\f{A^''^) . 

• Aa;.Eti^i = EtiAx.Mi, 

• (Eti^.)(E-=i^'.) = (E„-M.P,), 

• [(EtiM.)]WP = Eti[M.]WP, 

• [(EtiM.)']WP=[Mi,...,M!]WP. 

These equalities make sense since all constructors, but the (•)', are linear. Notice the dif- 
ference between these rules and the analogous ones for the differential A-calculus introduced 
in Notation 12. 4[ In the differential A-calculus the application operator is only linear in its left 
component while here it is bilinear. 

Definition 6.3 Let A be an expression and N be a resource X-term. 

• A{N/x} is the usual substitution of N for x in A. It is extended to sums as in A{It\l/x} 
by linearit'^^ in A. 

• A{N/x) is the linear substitution defined inductively as follows: 

INI \ = / ^ = ^ {Xy.M){N/x) = Xy.M{N/x) 

y^^^l^l |o otherwise {MP){N/x) = M{N/x)P + M{P{N /x)) 

[M]{N/x) = [M{N/x)\ ^{N/x) = 

[M-]{N/x) = [M{N/x), M-] (P a R){N/x) = P{N/x) W P + P W R{N/x) 

It is extended to A(IN/x) by bilinearit^ in both A and iNl. 



A unary operator F{-) is extended by linearity by setting FCEiAi) — 'Si^jF{Ai). 

A binary operator F{-, •) is extended by bilinearity by setting FCEiAi, T,jBj) = T.ijF{Ai, Bj). 



30 



Giulio Manzonetto 



The operation M{N/x) on resource A-terms is roughly equivalent to the operation ^-T on dif- 
ferential A-terms (cf. Lemma |6. 1 II below) . Notice that in defining [M']{N/x) we morally extract 
a linear copy of M from the infinitely many represented by M', that receives the substitution, 
and we keep the other ones unchanged. 

Example 6.4 

1. x{M/x) = M and y{M/x) = 0, 

2. (x[x])(M + Njx) = {M + N)[x] + x[M + N] = M[x] + N[x] + x[M] + x[N], 

3. {x[x-]){M + N/x) = {M + N)[x-] + x[{M + N),x-] = M[x-] + N[x-] + x[M,x-] + x[N,x-], 

4. {x[x-]){M + N/x} = {M + N)[{M + N)-] = M[M- , N-] + N[M\ N']. 

As a matter of notation, we will write L for Li,...,Lk and N' for N[,...,NI^. We will 
also abbreviate M{Li/x) ■ ■ ■ (L^/x) in M{L/x). Moreover, given a sequence L and an index 
1 < i < k we will write L_j for Li, . . . , Lj+i, . . . , L^,. 

Remark 6.5 Every applicative resource X-term MP can be written in a unique way as M[L, N'] . 

6.2. Resource Lambda Theories 

We now define the equational theories of the resource calculus, namely the resource X-theories. 
To begin with, we present the main axiom associated with this calculus: 

in iXx.M)[L,N'-] = M{L/x){^UNi/x} 

Notice that, when n = 0, this rule becomes {Xx.M)[L] = M{L/x){0/x}. Once oriented from 
left to right, the (/3^')-conversion expresses the way of calculating a function Xx.M applied to a 
bag containing depletable resources L and perpetual resources N. 

Remark 6.6 The left-to-right oriented version of {P"^) corresponds to the equational version 
of the giant-step reduction, in the terminology of [ \31f. In the same paper the authors also 
consider a baby-step reduction rule. They prove that both reductions are confluent and that 
every giant-step can be emulated by several baby-steps. For our purposes we can consider the 
rule {(3^) without loss of generality, because both reductions generate the same equational theory. 

In the resource calculus the axiom equating all resource A-terms having the same extensional 
behaviour has the shape: 

ijf) Xx.M[x-] = M, where x ^ FV(M). 

The resource calculus can be seen as a proper extension of the classic A-calculus. 

Remark 6.7 The classic X-calculus can be easily injected within the resource calculus. Indeed, 
given an ordinary X-term M , it is sufficient to translate every subterm of M of shape PQ into 
In this restricted system, the rules (/?'') and [rf) are completely equivalent to the classic 
(/3) and {rf)- conversions, respectively. 

We now define the equational theories associated with this calculus, namely the resource 
X-theories. 

A X^ -relation TZ is any set of equations between sums of resource A-terms (resp. bags). Thus 
TZ can be thought binary relation on J\f{A^^^). 
A A^-relation TZ is called: 
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an equivalence if it is closed under the following rules (for all A, B, C G J\f{A^^^)): 

n . ., B = A , A = B B = C ■ ■ 
renexivity symmetry — transitivity 



A = A A = B-' ■' A = C 

• compatible if it is closed under the following structural rules (for all M,Mj € J\f{A^), P G 
J^iA''), M, Mi G A"^ and P e A''): 

M = M , , , M = M P = P „„„ 
lambda niF, — '^t^" 



Xx.M = Ax.M MP = MP 



M = M P = P , M,- = Mi for all 1 < i < n 



bag 



sum 



[M«]ap = [M(')]ap Er=i ^« = Er=i Mi 

As a matter of notation, we will write 7^ h M = M or M =7^ M for M = M G 7^. 

Definition 6.8 A resource A-theory is any compatible -relation TZ which is an equivalence 
relation and includes (/3^). TZ is called extensional if it also contains {r]'^). 

We denote by A/3'~ (resp. Xfirf) the minimum resource A-theory (resp. the minimum extensional 
resource A-theory). 

Example 6.9 

1. A/3'' h {\x.x[x\)[l] = 0, A/3'' h (Ax.x[x])[I,I] = I and A/3'- h (Ax.x[x])[I, I, I] = 0, 
A/3'' h (Ax.x[x])[M,iV] = Af[iV] + N[M], 

3. A/3'' h (Ax.x[x,x])[(Ay.y[y'])!] = {\x.x[x'])[\y.y[yX\z.z[z']] = 2iXy.y[y'-])[{^z.z[z'-]y], 

4. \(5rf h {\xz.y[y][z-])\\ = Xz.y[y][z-] = y[y]. 

6.3. From the Resource to the Differential Lambda Calculus. . . 

In this subsection we show that every linear reflexive object living in a Cartesian closed 
differential category is also a sound model of the untyped resource calculus. This result is 
achieved by first translating the resource calculus in the differential A-calculus, and then applying 
the machinery of Section [H 

Definition 6.10 The resource calculus can be easily translated into the differential X-calculus 
as follows: 

• x'^ = X, 

• {Xx.Mf = Xx.W^, 

. (M[Li, . . . , Lfc, iVj, . . . , Nl]y = {D'^M'^ . {Li Li)){J:UNf). 
The translation is then extended to elements in J\f{A'^) by setting (S^^^^Mj)'^ = 'E'^^^Mf. 

The next lemma shows that this translation behaves well with respect to the differential and 
the usual substitution. 

Lemma 6.11 Let M,N G A'' and x be a variable. Then: 
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(i) {M{N/x)Y = ^-N^, 

(ii) {M{N/x})'^ = M'^{N'^/x}. 

Proof, (z) By structural induction on M. The only difficult case is M = M'[L,N-]. By 
definition of (— and of linear substitution we have: 

{{M'[L,N-]){N/x))<^ = {M'{N/x)[L,N-]f + {M'{[L,N-]{N/x))Y = 
{M'{N/x)[L,N'-]f + {E';^,M'[L,{N/x),L.,,NY + {^tiM'[N,{N/^ 

V ' ^1 , ' ^ V ' 

(1) (2) (3) 

Let us consider the three addenda separately. 

(1) By definition of {-)'^ we have that {M' {N/x)[L, N-j^ = {D^{M'{N/x)f ■ {L'^)){^f^^Nf). 
By applying the induction hypothesis, this is equal to (D^ ( ^^^ • N'^) ■ {L'^)){T,'^^-^^Nf). 

(2) By definition of the translation map (-)'^ we have that {J:'^^^M'[Lj{N/x),L^j,N-])'^ = 
^=i{D^'^ i^M"^ ■ {Lj{N/x)Y) ■ (Llj.))(5^r=i^/)- By applying the induction hypothesis, this is 
equal to T.]^^{D^-^ {D M"^ ■ • N'^)) ■ {L'i^)){^f^^Nf). 

(3) By definition of (-)'^ we have {J:'^^^M'[Nj{N/x), L, N-]f = ^^^[M'[Nj{N/x),L.N-]f = 
S^=i(D'=(DAf'"' • {Nj{N/x)Y) ■ {L'^)){Y.f^^Nf). By applying the induction hypothesis, this is 

equal to ^^-^{D'' {D M"^ ■ (-^ • N'^)) ■ [L'^)){T.'^^^Nf). By permutative equality this is equal to 

— * BN^ 

To conclude the proof it is sufficient to verify that ^((D'^M"^ ■ (L'^))(Sf^iiV|')) • N'^ is equal 
to the sum of (1), (2) and (3). 

[a) By straightforward induction on M. ■ 

The translation (•)'^ is 'faithful' in the sense expressed by the next proposition. 

Proposition 6.12 For all M G we have that X/3'' \- M = N implies XP'^ \- M'^ = N"^. 

Proof. It is easy to check that the proposition holds for the contextual rules. 

Suppose then that A/3'' h M = iV because M = {Xx.M')[L, N-] and = M'{L/x){J:f^^Ni/x}. 
By definition of the map {- f we have {{Xx.M')[L, N-]^ = (D'=(Ax.M'^) • {L'^)){J:f^^Nf) =^pd 
(^^■fiS ■ i^^iT.^^^Nf) =^f,, (gg • {L'')){J:^^Nf/x} which is equal to N'^ by LemmaEHl 
■ 

Remark 6.13 The two results above generalize easily to sums of resource X-terms (i.e., to 
elements M G J\f{K^) ). 

6.3.1. Interpreting the Resource Calculus by Translation 

Given a linear reflexive object ^ living in a Cartesian closed differential category C it is 
possible to interpret resource A-terms trough their translation (— )'^. Indeed, it is sufficient to 
set 

= iM% -.u^^u. 

From this fact. Proposition 16.121 and Remark 16.131 it follows that is a sound model of the 
untyped resource calculus. 

Remark 6.14 // is an extensional model of the differential X-calculus, then it is also an 
extensional model of the resource calculus. Indeed \{Xx.M[x-])% = \Xx.M'^x\g = \M%. 
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6.4. And back. . . 

In this subsection we define a translation from the differential to the resource calculus. This 
translation is more tricky because in the differential A-calculus the result of the linear applica- 
tion D(Ax.s) • t mantains the lambda abstraction (since it waits for other arguments that may 
substitute the remaining occurrences of x in s), while the naively corresponding resource A-term 
{Xx.M)[N] does erase it (since all other free occurrences of x in M are substituted by 0). 

Definition 6.15 The differential X-calculus can be translated into the resource calculus as fol- 
lows: 

= X, 

{Xx.sY = Xx.s"^, 

{sTY = s^[(r'')'], 

(D'^s • (ti, . . . , tk)Y = Xy.s^[ti, . . . , tl.,y'], where y is a fresh variable and k > 1, 
{s + SY = s'" + s"-. 



Notice that while the shape of the term Xy.s'^[tl, . . . , i^, y ] looks similar to an (r/'')-expansion 
of s^[ti, . . . it is not! Indeed, in the (?7^)-rule, y- is supposed to be in a singleton bag. 



Lemma 6.16 Let S,T G A'^ and x be a variable. Then: 

(i) {§-TY = S^{T^/x), 

(ii) {S{T/x}Y = S^iT'^/x}. 

Proof, {i) By structural induction on S. If 5 is a variable, a lambda abstraction or a sum, the 
lemma follows straight from the induction hypothesis. 

• case S = s ■ {ti, . . . ,tk)- We have: 

(^(D*^s-(ti,...,tfe))-rr = 

= j:l,{{D's-{ti,...,^-T,...,tk))Y 

+ {{DH§l-T)-itu...,h))Y bydef.of^.r 
= J:ti^y.s^[tl,...,i^-TY,...,tl,y'-] 

+ Xy.{^-TY[tl,...,tl,y'-] bydef.of (-r 
= j:l,Xy.s-[tl,...,tl{T^/x),...,tly'-] 

+ Xy .{s"^ {T^ / x))[ti, . . . by induction hypothesis 

= iXy.s^[t\, . . .,tl,y'-]){T-/x) by def. of {T^/x) 

= (D*^s ■ (ti, . . .,tk)Y{T'/x) by def. of {-Y 

• case S = sU. By definition, we have (^^ • TY = ((^ • T)U + (Ds • • T))UY = 
((f • T)UY + ((D. • (f • T))UY = (i • TYmn'-] + (A2/..^[(f • TY,y'mun-]- By 
induction hypothesis this is equal to {s'' {T' / x))[{U'')-] + (Xy.s''[U'' {T'' /x),y-])[{U'')-]. By 
/3-conversion this is equal to (s''(r7a;))[(C/^)'] + s^[i7'^(r7x), {U"")-]. By definition of linear 
substitution this is {s'-[{W)-]){T^ /x) = {sUY{T''/x). 

(ii) By straightforward induction on S. ■ 

The next proposition shows that also the translation (•)'' is faithful. 



Proposition 6.17 For all S,T e A"^ we have that Xp^h S = T implies XP'' h 5'^ = T^ 
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Proof. It is easy to check that the proposition holds for the contextual rules. 

Suppose that X^'^ \- S = T holds because S = D'^(Ax.s) • (ui, . . . ,Uk) and T = Xx.^^-^ ■ 
. . . , Uk)- Then we have 

= Ay.(Ax.sOK,...,4,y'] bydef. of(-r 
=\I3^ '^y-s^ (ui/x) ■ ■ ■ {ul./x){y /x} by /^''-conversion 
= Xx.s^ {u\/x) ■ ■ ■ (ul/x) by a-conversion 

= "^^-i dxy^x • (^1' • • • ^'^k)Y by Lemma 16J6(i) 
= T"- "'" by def. of {-Y 

m 

The two translations (•)'^ and (•)'" are not exactly one the inverse of the other one. The next 
proposition summarizes the properties that they do satisfy. 

Proposition 6.18 The translations (•)'^ and (•)'' enjoy the following properties: 

(i) (s*")^ = s, for all usual X-terms s, 

(ii) {S'^f ^ S and {^'^Y ^ M, for some 5 G A'^ and M G AA(A^), 
(Hi) XPri"^ h {S^'Y = S, for all S G A"', 
(iv) Xf3'' h (M^)'' = for all M G A/'(A'-). 

Proof, (i) By straightforward induction on the structure of s. 

(ii) For instance ((Dx • x)'")"' = {Xy.x[x,y']Y = Xy.{Dx ■ x)y ^ Dx • x. On the other hand we 
have {{x[L\YY = ((Dx • yW = {Xz.x[y, z'])0 ^ x[L]. 

(Hi) By induction on the structure of S. 

• case 5 = D'^s • (ii, . . . ,tk). By definition of (•)'" we have that ((D*^s • (ii, . . . ,tk)YY is 
equal to {Xy.s'lfl, ■ ■ ■ ,tl,y-]Y = Xy.{D^{s''Y ■ {{tiY, ■■■ , {^lYYv- By induction hypoth- 
esis we have {s''Y =\/5n'i s and {t^Y =xi3r]'' all 1 < i < A;, thus Xy.{D'' {s'^Y ' 
mY, {tlY))y =xpr,'^ Ay.lD'^. ■ (ii, . . . , tk))y =,^,. D'^ s ■ {t,, . . . , tj,). 

• case S = sT. We have {{sTYY = {s''[{T'')-]Y = {s''Y{T''Y- By induction hypothesis, we 
know that {s'Y =\pr)i « and {T^'Y =A/3r,d T, thus we conclude {s''Y{T''Y =\pr,d sT. 

• All other cases are trivial. 

{iv) By induction on the structure of M. The only interesting case is M = M[L, iV']. We 
have {{M[L,N-]YY = {{D'' ■ {L'^)){T.f^^Nf)Y = (Ay.(M'^)''[(L"')^ y'])[((iV'^)^)']. By in- 
duction hypothesis we know that {M'^Y =\li'' i^'jY =\li'' and {NfY' =\i3'- ^i, thus 
{Xy.{M^Y[iL''Y,y-]mN''Y)-] =Ar {Xy.M[L,y'-])[{N)-]. Since y ^ FV(M,L) we have that 
{Xy.M[L,y'-])[{Ny] =^pr M[L,N'-]. m 

7. Discussion, Further Works and Related Works 

In this paper we proposed a general categorical definition of model of the untyped differential 
A-calculus, namely the notion of linear reflexive object living in a Cartesian closed differential 
category. We have proved that this notion of model is sound (i.e., the equational theory induced 
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by a model is actually a differential A-theory), and inhabited (indeed we gave a concrete example 
of such a definition). 

Finally, we have shown that the equational theories of the differential A-calculus and of the 
resource calculus are tightly connected. Formally, we have provided faithful translations between 
the two calculi, thus showing that they share the same notion of model. In particular, this shows 
that linear reflexive objects in Cartesian closed differential categories are also sound models of 
the untyped resource calculus. 

7.1. Other Examples of Cartesian Closed Differential Categories 

In Section [5] we have presented IVIRel (and cited MFin in Remark 15. ip as an instance of the 
definition of Cartesian closed differential category. We briefly discuss here other examples of 
such categories that have been recently defined in the literature. 

In the forthcoming paper [|28] we have described, in collaboration with McCusker, a Cartesian 
closed differential category G based on games, i.e., having arenas as objects and strategies as 
morphisms. In this category strategies are defined as arbitrary sets of complete plays that are 
fully justified, well-bracketed and satisfy suitable visibility conditions. As expected, since the 
differential A-calculus is intrinsically non-deterministic, also the strategies we consider are non- 
deterministic. Complete plays are needed to check easily whether a strategy plays on a certain 
component exactly once; intuitively this captures the fact that such a strategy is linear in that 
component. This category of games, just like IVIRel, models the Taylor expansion. Actually, 
these two categories share many properties as G can be 'collapsed' into IVIRel in the sense that 
it is possible to define a time- forgetting lax- functor from G to IVIRel in the spirit of [ [2] . 

Natural examples of differential Cartesian closed categories that do not model the Taylor 
expansion have been recently defined in [[13] by introducing new exponential operations on Rel. 
The intuition behind this construction is rather simple: the authors replace the set of natural 
numbers (that are used for counting multiplicities of elements in multisets) with more general 
semi-rings containing elements uj such that uj + 1 = uj (i.e., elements that are morally infinite). In 
these models with infinite multiplicities all differential constructions are available, but the Taylor 
formula does not hold. Indeed, in these categories it is possible to find a morphism / 7^ such 
that, for all n G TV, the n-th derivative of / evaluated on is equal to 0: the Taylor expansion 
of such an / is the map, and hence the morphism is different from its Taylor expansion. In 
particular, the authors exhibit models where the interpretation of is different from 0. 

7.2. Completeness and Incompleteness 

The categorical notion of model of the classic A-calculus enjoys a completeness theorem [ 133] 
stating that every A-theory T can be represented as the theory of a refiexive object in a particular 
Cartesian closed category. The proof of this theorem is achieved in two steps: (i) given a A- 
theory T one proves that the set of A-terms modulo T together with the application operator 
defined between equivalence classes constitutes an applicative structure that can be endowed 
with a structure of A-mode0 (usually called "the term model of T"); (m) by applying to 
^j- a construction called Karubi envelope [ 26] one builds a (very syntactical) Cartesian closed 
category Cj- in which the identity I is a refiexive object such that Th(I) = T. 

We conjecture that the categorical notion of model of the differential A-calculus proposed in 
this paper enjoys a similar theorem. However, to adapt the original proof to this framework we 
would need first to understand what is a suitable algebraic notion of model of the differential 
A-calculus, in order to built the term model. Preliminary investigations on this subject have 

^ A 'A-model' is a combinatory algebra satisfying the five axioms of Curry and the Meyer-Scott axiom. We refer 
to [131 Ch. 5] for more details. 
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been recently made by Carraro, Ehrhard and Salibra in [Ej, where the authors provide a notion 
of "resource A-models" and show that they can be used to model the strictly linear fragment of 
the resource calculus (i.e., the fragment without (■)'). At the moment, a generalization allowing 
to model the full fragment of resource calculus (or, equivalently, the differential A-calculus) does 
not seem easy, and is kept for future work. 

We would like to conclude this subsection by noticing that - although the completeness the- 
orem is interesting from a theoretical point of view - it is not really helpful for the working 
computer scientist. Indeed, as noticed above, the term models and the corresponding cat- 
egorical models I living in C7- are rather syntactical. Thus, proving properties of A-terms via 
these models does not make it any easier than working directly with the syntax. On the other 
hand, the non-syntactical semantics of A-calculus known in the literature (e.g., the continuous 
semantics [ i34j , the stable semantics [ 0] , the strongly stable semantics [ |9] and the relational 
semantics [HO]) are all hugely incomplete — there are 2^" A-theories that cannot be represented 
as theories of models living in these semantics. This follows from a general theorem proved by 
Salibra in [l32|. The problem of finding a non-syntactical complete semantics is still open, and 
very difficult. 

7.3. Working at the Monoidal Level 

Another interesting line of research is to characterize categorical models of the differential 
A-calculus at the level of SMCC's (symmetric monoidal closed categories). In [|6|, Blute et al. 
show that (monoidal) differential categories [ [5] give rise to Cartesian differential categories via 
the co-Kleisli construction. In the same spirit, we would like to provide sufficient and necessary 
conditions on SMCC's for giving rise to Cartesian closed differential categories (indeed, all the 
examples given in Section [5] and Subsection 17.11 may be generated in this way). 

Notice that, in monoidal frameworks, categorical proofs become often awkward due to the 
symmetric properties of the tensor product . It would be then interesting to define a graphical 
formalism allowing to represent in a pleasant and intuitive way the morphisms of these categories. 
This formalism could be inspired by differential proofnets or interaction nets [|23], but should 
satisfy (at least) the following properties: there should be a 1-to-l correspondence between 
a morphism and its graphical representation (maybe up to some well chosen equivalence on 
morphisms); the formalism should not ask for extra properties of the category, like the presence 
of the operator ^ or the dualizing object _L. 

Acknowledgements. We are grateful to Antonio Bucciarelli, Thomas Ehrhard and Guy 
McCusker. Many thanks to Michele Pagani and Paolo Tranquilli for helpful comments and 
suggestions. 
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A. Technical Appendix 

This technical appendix is devoted to provide the full proofs of the two main lemmas in Subsection 13.31 These 
proofs are not particularly difficult, but quite long and require some preliminary notations. 

Notation A.l We will adopt the following notations: 

• Given a sequence of indices i — ii, . . . ,ik with ij G {1,2} we write ttj for iTi-^ o ■ ■ • ott^j^ . Thus tti 2 = tti 7r2. 

• For brevity, when writing a Cartesian product of objects as subscript of or Id, we will replace the operator x 
by simple juxtaposition. For instance, the morphism ld(^AxB)x(CxD) will be written U(^yiB)(CD)- 

Hereafter "(proj)" will refer to the rules tti o (/, g) = / and tt2 o {f,g) ~ g that hold in every Cartesian category. 
We recall that sw^bc = ((TTia, 7r2), 7r2,i) : (A x B) x C ^ {A x C) x B. 
Lemma A.2 (Lemma\^AT^ Let f : {C x A) x D ^ B , g : C ^ A, h : C ^ B' . 

(i) 7r2 Tk-g = .goTTi, 

(ii) (ft-OTTl) = 0, 

( Hi) A(/) ★ 5 = A(((/ o sw) ★ (5 o TTi)) o sw) . 
Proof, (i) 

TT2-^9= D(7r2)o ((0c,go7ri),IdcA) bydef. of* 
= Ti2OTTio{{0c,goTTi),ldcA) by D3 
= 7r2o(0c,5O7ri) by (proj) 

= goTTi by (proj) 

(ii) 

{ho-Kij-kg^ Z3(/io7ri) o ((Oc, ffOTTi), Idcyi) bydef. of* 

' = D{h)o{D{ni),TTia){{Qc,goTTi)McA) byD5 
= i:)(/i)o(7riO7ri,7ri,2)o((0c,go7ri),IdcxA) by D3 
= D{h)o{Qc,T^i) by (proj) 

= by D2 

(iii) We first prove the following claim. 

Claim A. 3 Let g : C ^ A, then the following diagram commutes: 

{CxA)xD .(Cx{CxA))xD ((oc..)xidc..)xid. ^ ^^CxA)xiCxA))xD 

(7rixldr>,sw) (tti X Od ,712 X Idu) 

(CxJ)x((CxJ)xA) ^°"'^°'^°"^^''''"'^""^:-^ {{CxD)xA)x{{CxD)xA) ^^^-^'^ > , {iCxA)xD)x{{CxA))x 
Sub-proof. 

(tti X 0n,7r2 X IdD)o(((Oc,g) x Uca) x Id^) o ((tti, Wca) x Ud) = 
(((0c,5O7I"i4),0d), (7r2,i,7r2))o((7ri, (7ri,7r2))o7ri,7r2) = 
{{{0c,9°'^i,i),0d), (7r2,i,7r2))o((7ri4, {tti,i,tt2,i)),tt2) = 
(((0c,go7ri,i),0D), ((7ri,i,7r2,i),7r2)) = 
(((0c,go7ria),0D), ((7ri,i^2,7r2,2),7r2,i,2)>o(7ri xld^sw) = 

(((7ri,l,l)'^2,l)i'^2,l,l)> ((7ri,l,2,7r2,2),7r2,l,2))o((0ci3,5°'^l,l),'^2)o(7ri X Id_D,sw) = 

(L'(sw),swo7r2)o((0c_D,5O'^i) X Id(CD)A)o(7ri xIdD,sw) 
We can now conclude the proof as follows: 

A(/)*.g= DiAif))o{{0c,go7r,)McA) bydef. of* 

= A(i:)(/)o(7ri X 0D,7r2 X IdD))o((0c,go7ri),IdcA) by (D-curry) 

= A(i?(/)o(7ri x0i5,^2 xIdD)o((((0c,5O7ri),IdcA)) xld^)) by (Curry) 

— A(£)(/)o(£)(sw),swo7r2)o((0cD,ffO7ri) X Id(C£))A)o(7ri xld£),sw)) bv Claim I A. 31 

= A(i:)(/osw)o((0cD,go7ri} x Id(cD)yi)o(7ri,Id)osw) by D5 

= A(((/osw) * (5 7ri))osw) by def. of * 
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Lemma A.4 (Lemma[3JM) Let f : C x A ^ [D^B], g : C ^ A, h : C x A ^ D 

(i) (ev o (/, /j)) * g = cv o (/ * ,g + A(A- (/) * (/i * .g)), h) 

(ii) A(A- (/) ^h)^g = A(A- {f^9)*h) + A(A- (/) ^{h^ g)) 
(ill) A(A-(/) * h) o (Idc, .g) = A(A- (/ o (Idc, g))^{ho (Idc, 5))) 

Proof. 

(i) Let us set ip = ((Oc, <?o7ri), Idc^)- Then we have: 

(evo(/, h))^g = 
iD(evo (/, h))oif = 

(ev O (D (/) , /l O ^2 ) + ^ ( A- (/) ) O ( (Oc A , (M ) , (712 > O 712 ) ) ) o <^ = 

evo {D{f),hoTT2) o + D{A- (/)) o ((Oca, i?(/») o f), {Uca, h)) = 
evo{D{f )oip, h) + Z?(A-(/)) o {{Oca, {h * 5) Id(CA)D) ° (Mca, h) 
ev o (/ * /i) + (A- (/) *{h*g))o{ld,h) = 
evo(/*5r,/i) +evo(A(A-(/)*(/i*5r)),/i) = 
evo{f^g + AiA-if)*{h*g)),h) 



by def. of ★ 
by (D-eval) 
by Def. [3j 
by def. of * 
by def. of * 
by (beta-cat) 
by Lemma 



(ii) We first simphfy the equation A(A^(/)*/i)*g = A{A^{f-kg)-kh)+A{A^{f)-k{h-kg)) to get rid of the Cartesian 
closed structure. The right side can be rewritten as A{{A~ {f -k g) -k h) + A~ (f) -k {h-k g)). By taking a morphism 
f':{CxA)xD^B such that / = A(/') and by applying Lemma (XTZK***) we discover that it is equivalent 
to show that: 

((/' ★ h)osw) k {goTTi)osw — (((/' osw) * (5 o tti)) o sw) k h + f' k [h k g). 
By definition of ★ we have: 

((/'★/i)osw)*(go7ri)osw = D{D{f') o {{Oca, ho {711^1,112)), sw))o {{Ocd, 9° t^i,i),sw) 
Let us call now ip = ((0c_D,5O7ri^i), sw) and write D^{f ) for D{D{f)). Then we have: 



D\f) o {{OcA,ho{TTi,i,w2)),sw))oip = by D5 

D2(/') o {D{{{Oca, /lo (tti^i, 7r2)), sw)), {{Oca, ho {711^1,112)), sw) 0112) oip ^ by (pair) 

D'^{f')o{D{{{QcA,ho{ni^i,Tr2)),sw))oip,{{0cA,ho{Tri^i,n2)),sw)oTr2oip) = by D4 

D'^if) ° ((£^((OcA, ho {711^1,112))) o If, D{sw)oip), ((Oca, /lo (tti,!, 7r2)), sw) osw) = by Rem. 13.161 
° ((^((OcA, /lo (7ri,i, 7r2))) o D{sw)o^), ((Oca, /iotti), Id(cA)D)) 



Since (£)((0cA,^o(7ri,i,7r2)))oi^,£)(sw)o(p) = {0,D{s-w)oip) ^ 
and rewrite the expression above as a sum of two morphisms: 



{D{{OcA, ho (vTi^i, 7r2))) o (p, 0) we can apply D2 



(1) D^f)o{{0^cA)D,D{sw)o^),{{0cA,ho7Ti),ld{CA)D)) + 

(2) D^f ) o ((i?((OcA, (7ri,i, 7r2}}) o O(ca)d), ((Oca, ho7ri)MiCA)D)) 

We now show that (1) = (((/'osw) * (go7ri))osw) Indeed, we have: 
^^(/')o((0(CA)i3,^(sw)o^),((0cA,/iO7ri),Id(cA)D)) = by Rem. [SH] 

-D^(/')o((0(CA)n,swo7riO93), ((0cA,^o7ri),Id(cA)D)) = by (proj ) 

^^(/')°((0(CA)n,swo(0cD,.go7ri,i)), ((Oca, /iotti), Id(cA)n)) = by Rem.|3T6| 

^'(/')°((0(CA)D,((0c,5O7ri,i),0i3)),((0cA,/iO7ri),Id(cA)D)) = by D7 

D^if) o ((((Oc, Oa), Oi,), (Oca, /^o^i)), (((Oc, go^i.i), 0^^), Id(cA)i3)) = by D2 

^'(/') ° ((((Oc, I)(g) o (Oc, vri,i)), Oz3), (Oca, ho^)), (((0c,.go7ri,i), Oi,), Id(cA)D)). 

Let us set ip = {{Oca, hoTri),ld(^cA)D)- Then we have: 



What is a categorical model of the differential and the resource X-calculi? 



41 



D{D{f))o{{{{0c,D{g)o{0c,n,,i)),0D)A0cA,hon,)),{{{Qc,9oni,i),0D)MicA)D)) = 

^P(/))°((((0c,-D(ff)°(^l,l.l:^l,1.2)),0z3),^l),(((0c,go^l,1.2),0z,),^2))oV = 

^P(/))°((((0c,i5(ff)°(i^(7ri.i),^i,i.2)),0,5),vri),(((0c,5°7ri.i,2),0,5),7r2))oV7 = 
^P(/))°((((0c,i^(go^i.i)),0i3),^i),(((0c,go^i.i,2),0z3),7r2))oV^ = 

°((((^(Oc),i^(go^i.i)),I?(Oc)),^(Id(cA)D)),(((Oc,ff 0^1.1,2), 0D),7r2))o 

Z?p(/))o(I?((((0c,5°7ri,i),0i3},Id(cA)D)),(((0c,5O7ri,i),0,,),Id(CA)D)o7r2)oV = 

i^p(/)o(((0c,5°7ri,i),0i3),Id(cA)D))oV = 

D{D{f) o (swo (OcD, OTTi^i), swosw)) o?/; = 

D{D{f) o (swoTTi, swo7r2) o ((Ocn, goTTi^), sw}) O-0 = 
D{D{f) o {D{sw), swo7r2) o ((Ocu, .9 otti^i}, sw)) of/; = 

D(D(/osw)o((0cD,ffO7ri,i),Id(cD)A)osw)o((0cA, /io7ri),Id(cA)D) = 
(((/osw) * (goTTi)) osw) ★ h 

We will now show that (2) = f -k {h -k g), and this will conclude the proof. 

o ((-D((Oca, (tti,!, TTa}}) o (p, O(ca)d), ((Oca, /iotti), Id(cA)D)) = 
o (((Oca, ^(/lo (tti,!, tts))) o ip, O(ca)d), ((Oca, /iotti), Id(cA)D)) = 
D^if) ° (((Oca, £'(/i) o (£'((7ri,i, tts)), (7ri,i,2, 7r2.2))) o (^3, O(ca)d), ((Oca, /iotti), Id(cA)D)) = 

i^'(/)°(((0cA,-D(ft)o((i?(^l,l),i?(^2)),(7ri,i,2,^2,2)))o(p,0(cA)D),((0cA,/iO7ri),Id(cA)D)) = 

D^if) ° (((Oca, -D(ft) o ((7ri,i,i, 7r2,i), (7ri,i,2, 7r2,2))) o f, O(ca)d), ((Oca, /iotti), Id(cA)D» = 
!)'(/) o (((Oca, ^(ft)o ((0c,5°7ri,i), tti)), O(ca)i)), ((Oca, /lo^i), Id(cA)i3)) = 
D(/) o ((Oca, D{h) o ((Oc, g o7ri,i), tti)), Id(CA)D) = 
D{f ) o ((Oca, o ((Oc, otti), Wca) otti), Id(CA)D) = 



by (proj) 
by D3 
by D5 
by Dl 
by D4 
by D5 

by Rem. [3l6l 

by (proj) 

by Rem. KW 
by D5 
by def. of ★ 



by Dl+4 
by D5 
by D4+D3 
by D5+D3 
by (proj) 
by D6 
by (proj) 
by def. of ★ 



{in) By (Curry) we have A(A~ (/) ★ /i) o (Idc, .g) = A((A~ (/) ★ /i) o ((Idc, .g) x Id^)), thus if we show that (A~(/)* 
h) o ((Idc, g) X Md) = A^(/o (Idc, 5)) -k {ho (Idc, 5)) we have finished. 



We proceed then as follows: 

{A-{f)kh)o{{ldc,g) X Idz,) by def. of* 

D{A-{f))o{ (Oca ,ho7r,), M^ca)d) ° { (Wc , g) x Id^ ) = by def. of A" 

L)(evo(/o7ri,7r2))o((0cA,/io7ri),Id(cA)r>)°((Idc,5) x Idn) = by D5+D4 

D(ev) o ((£>(/ oTTi), 15(772)), (/o7ri,2, 7r2,2)) o ((Oca, h) o (^1, 5 otti), (Idc, 5) x Id,,) = by D5+D3 

-D(ev)o((£)(/)o(7ri^i,7ri^2),7r2,i),(/o7ri^2,7r2,2))o((0cA,/io(7ri,.go7ri)),(Idc,.g) x Ida) = by (proj) 

-D(ev)o ((£)(/) o (Oca, (tti, goTTi)), /lo (tti, goTTi)), (/o (7ri,.go7ri), tts)) = by D2 
D(ev) o ((D(/) o ((Oc, i?(5) o (Oc, Idc)), {ldc,g)),ho{m,gom)), (/o (Idc, 9)Md)) = 
by setting (p = ((Oc, /io (tti, goTTi)), Idcn) 

i:'(ev)o((D(/)o((7ri,i,D(5)o(7ri,i,7ri,2)), (7ri,2, o7ri,2)), 7r2,i), (/ o (7ri,2, go7ri^2), 712,2)) o (y^ = by D5 

D(ev)o((D(/o(7ri, 5071-1)), D(7r2)), {f o {tti^2, g otti^2) , 7^2,2)) o f = by D4 

L'(ev)o(i:)((/o(7ri,507ri),7r2)), {f o {Tri^2, g o 7^1,2) , 7^2,2)) o ip = by D5 

D{evo (/ o (tti, (/oTTi), 712)) o(p = by def. of A~ 

i:>(A-(/o(Idc,.g)))o^ = by def. of* 
A-(/o(Idc,g))*(/io(Idc,g)) 



